-- Logs begin at Wed 2021-09-01 16:20:27 UTC, end at Wed 2021-09-01 17:17:40 UTC. -- Sep 01 16:50:04.165001 dv-cinder-799668-16-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Sep 01 16:50:06.897995 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.common.config [-] Logging enabled! Sep 01 16:50:06.898582 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev574 Sep 01 16:50:06.898785 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=93726) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Sep 01 16:50:06.902326 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.common.config [-] Logging enabled! Sep 01 16:50:06.902586 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev574 Sep 01 16:50:06.902984 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=93726) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Sep 01 16:50:06.903926 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:50:06.904168 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:50:06.904544 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:50:06.904796 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:50:06.905028 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:50:06.905353 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.905695 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.905997 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.906231 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.906533 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.906832 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.907120 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.907413 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.907715 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.908004 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.908285 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.908572 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.908804 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.909084 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] config_source = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.909373 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.909685 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.909912 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] debug = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.910194 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.910618 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.911034 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.911319 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.911610 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.911890 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.912161 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.912438 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.912724 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.913052 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] host = dv-cinder-799668-16-iscsi {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.913331 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.913647 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.913936 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.914223 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.914497 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.914773 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.915058 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.915330 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] log_dir = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.915604 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] log_file = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.915882 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.916173 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.916461 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.916755 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.916982 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.917206 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.917522 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.917813 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.918091 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.918932 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.919306 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.919502 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.919777 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.920051 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.920340 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.920625 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.920911 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.921184 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.921484 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.921759 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.922032 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.922319 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.922593 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.922866 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.923140 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.923426 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.923696 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.923970 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.924269 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.924557 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.924838 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.925122 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.925406 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.925766 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.926040 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.926313 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] use_journal = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.926586 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] use_json = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.926861 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.927138 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.927419 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.927693 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.927962 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.928237 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.928508 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.928794 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:06.929093 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.929457 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.929715 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.930000 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.930297 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.930580 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.930873 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.931155 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.931447 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.931739 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.932028 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.932310 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.932601 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.932880 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.933178 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.933510 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.933811 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.935019 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.935133 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.935373 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.935656 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.935942 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.936236 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.936521 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.936817 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.937118 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.937422 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.937718 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.938014 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.938309 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.938587 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.938867 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.939162 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.939442 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.939717 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.939994 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.940284 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.940562 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.940836 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.941121 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.941420 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.941700 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.941978 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.942259 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.942552 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.942832 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.943107 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.943382 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.943661 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.943936 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.944222 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.944498 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.944774 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.945049 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.945326 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.945623 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.945896 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.946174 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.946447 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.946723 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.946997 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.947273 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.947546 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.947820 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.948093 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.948366 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.948639 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.948915 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.949189 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.949514 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.949829 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.950057 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.950492 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.950787 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.951089 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.951371 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.951651 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.951933 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.952212 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.952489 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.952765 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.953045 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.953325 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.953626 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.953920 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.954208 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.954496 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.954781 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.955061 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.955365 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.955647 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.955932 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.956211 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.956491 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.956776 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.957059 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.957363 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.957736 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.958036 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.958333 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.958629 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.958911 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.959221 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.959505 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:06.959726 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:50:06.959968 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=93726) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Sep 01 16:50:07.310559 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=93726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 01 16:50:07.310825 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=93726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 01 16:50:07.311079 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=93726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 01 16:50:07.311416 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.manager [-] Loading core plugin: ml2 Sep 01 16:50:07.706823 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.707110 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.707383 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.708690 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.708965 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.709230 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.743526 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.743803 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.744071 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.760581 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.760854 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.761128 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.789955 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.790235 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.790513 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.827151 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.827434 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:07.827705 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.059749 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.060277 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.060277 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.060565 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.061276 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.181337 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.181681 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.181969 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.182245 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.182516 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.182831 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.183095 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.183353 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.183610 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.184217 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.184491 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.184762 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.185023 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.185283 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.185570 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.185841 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.186099 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.186373 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.186648 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.186912 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.187186 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.187444 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.187728 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.188108 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.188361 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.188611 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.189005 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=93726) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 01 16:50:08.189247 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=93726) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 01 16:50:08.189509 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=93726) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 01 16:50:08.189751 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=93726) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 01 16:50:08.189989 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=93726) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 01 16:50:08.190227 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=93726) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 01 16:50:08.190590 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Sep 01 16:50:08.193705 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Sep 01 16:50:08.197644 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Sep 01 16:50:08.201589 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(500, 549)])]) Sep 01 16:50:08.203215 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Sep 01 16:50:08.203671 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Sep 01 16:50:08.204158 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Sep 01 16:50:08.204545 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Sep 01 16:50:08.207363 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Sep 01 16:50:08.207617 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Sep 01 16:50:08.207968 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Sep 01 16:50:08.213231 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Sep 01 16:50:08.236007 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Sep 01 16:50:08.236460 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.236758 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=93726) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Sep 01 16:50:08.237118 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.238487 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=93726) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Sep 01 16:50:08.238769 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Sep 01 16:50:08.239014 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Sep 01 16:50:08.242177 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.242459 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.306242 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Sep 01 16:50:08.306421 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Sep 01 16:50:08.306656 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Sep 01 16:50:08.307023 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Sep 01 16:50:08.328334 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_db.sqlalchemy.engines [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:50:08.864767 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Initializing driver for type 'gre' Sep 01 16:50:08.865300 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] gre ID ranges: [(1, 1000)] Sep 01 16:50:08.919517 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Initializing driver for type 'local' Sep 01 16:50:08.919845 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Initializing driver for type 'vlan' Sep 01 16:50:08.932770 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] VlanTypeDriver initialization complete Sep 01 16:50:08.933109 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Initializing driver for type 'vxlan' Sep 01 16:50:08.933630 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] vxlan ID ranges: [(1, 1000)] Sep 01 16:50:08.989143 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Initializing extension driver 'port_security' Sep 01 16:50:08.989532 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.extensions.port_security [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] PortSecurityExtensionDriver initialization complete Sep 01 16:50:08.989880 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Initializing mechanism driver 'openvswitch' Sep 01 16:50:08.990214 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Initializing mechanism driver 'hyperv' Sep 01 16:50:08.997439 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.plugins.ml2.plugin [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=93726) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:50:08.998144 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > port after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.998629 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > port after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.999060 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > port after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:08.999595 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=93726) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 01 16:50:09.000041 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > subnet after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.000408 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > subnet after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.000767 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > subnet after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.001170 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=93726) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 01 16:50:09.001610 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > network after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.001973 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > network after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.002325 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > network after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.002724 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=93726) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 01 16:50:09.003139 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > security_group after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.003499 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > security_group after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.003851 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > security_group after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.004386 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=93726) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 01 16:50:09.004805 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.005170 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.005555 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.005962 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=93726) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 01 16:50:09.006376 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > address_group after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.006742 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > address_group after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.007093 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > address_group after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.007491 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=93726) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 01 16:50:09.007878 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] ML2 OVO RPC backend initialized. {{(pid=93726) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Sep 01 16:50:09.008595 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router_interface after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.008963 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router_interface after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.009407 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > network before_response 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.009772 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > networks before_response 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.010131 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > port before_response 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.010484 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > ports before_response 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.010837 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > subnet before_response 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.011188 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > subnets before_response 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.011542 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > network after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.011891 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > network after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.012363 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > network after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.012715 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > port after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.013062 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > port after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.013430 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > port after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.013780 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > subnet after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.014127 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > subnet after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.014472 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > subnet after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.015057 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.plugin [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Modular L2 Plugin initialization complete Sep 01 16:50:09.015392 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading services supported by the core plugin {{(pid=93726) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Sep 01 16:50:09.015727 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.plugins.ml2.managers [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Got port-security extension from driver 'port_security' Sep 01 16:50:09.016202 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.extensions.vlantransparent [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Disabled vlantransparent extension. Sep 01 16:50:09.016692 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=93726) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Sep 01 16:50:09.017014 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading Plugin: router Sep 01 16:50:09.055506 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router_interface before_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.055913 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router after_create 55549900 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.056292 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router before_create 55549900 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.056666 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router_interface before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.057053 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router_interface after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.057453 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router after_delete 55549900 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.057825 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > floatingip after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.058186 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > floatingip after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.058554 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router after_create 55549900 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.058948 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router after_update 55549900 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.059305 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router after_update 55549900 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.059663 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.060030 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router after_update 55549900 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.060541 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router precommit_update 55549900 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.060815 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: port after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.061162 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: port after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.061542 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: subnet after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.061901 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.062262 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > port precommit_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.062625 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router precommit_create 55549900 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.062985 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: port before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.063338 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router precommit_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.063707 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router after_update 55549900 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.064062 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router precommit_delete 55549900 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.064425 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router precommit_create 55549900 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.064796 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router_interface after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.065154 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router precommit_update 55549900 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.065557 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > agent after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.065917 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > agent after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.066271 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > network after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.067147 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Tracking information for resource: router configured {{(pid=93726) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 01 16:50:09.067515 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Tracking information for resource: floatingip configured {{(pid=93726) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 01 16:50:09.072473 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.db.l3_agentschedulers_db [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Sep 01 16:50:09.073068 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: port after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.073466 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: port after_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.073833 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: port after_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.074200 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: port after_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.075209 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router before_create 55550100 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.075588 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router precommit_delete 55550100 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.075965 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router precommit_create 55550100 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.076335 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > router precommit_update 55550100 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.080930 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.services.provider_configuration [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service providers = [] {{(pid=93726) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Sep 01 16:50:09.081308 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.db.servicetype_db [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=93726) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Sep 01 16:50:09.084289 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.services.service_base [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=93726) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 01 16:50:09.084650 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.services.service_base [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=93726) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 01 16:50:09.085004 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.services.service_base [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=93726) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 01 16:50:09.085938 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.services.service_base [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=93726) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 01 16:50:09.086320 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.services.service_base [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Default provider is not specified for service type L3_ROUTER_NAT Sep 01 16:50:09.086707 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=93726) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 01 16:50:09.087034 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Sep 01 16:50:09.098743 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Successfully loaded METERING plugin. Description: METERING {{(pid=93726) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 01 16:50:09.099086 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading Plugin: auto_allocate Sep 01 16:50:09.104991 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: network precommit_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.105372 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: network precommit_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.106620 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=93726) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 01 16:50:09.106961 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading Plugin: tag Sep 01 16:50:09.113520 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=93726) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 01 16:50:09.113865 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading Plugin: timestamp Sep 01 16:50:09.117968 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=93726) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 01 16:50:09.118268 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading Plugin: network_ip_availability Sep 01 16:50:09.123792 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.124176 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.124544 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.125263 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=93726) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 01 16:50:09.125624 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading Plugin: flavors Sep 01 16:50:09.130339 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=93726) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 01 16:50:09.130682 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading Plugin: revisions Sep 01 16:50:09.134958 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=93726) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 01 16:50:09.135358 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_concurrency.lockutils [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.824s {{(pid=93726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 01 16:50:09.136097 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=93726) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}} Sep 01 16:50:09.136440 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Initializing extension manager. Sep 01 16:50:09.137576 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: __init__.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.137931 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: __pycache__ {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.138275 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.138615 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: address_group.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.139389 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.139968 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: address-group Sep 01 16:50:09.140302 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: address_scope.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.141036 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.141580 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: address-scope Sep 01 16:50:09.141989 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: admin_state_down_before_update.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.142954 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.143470 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: router-admin-state-down-before-update Sep 01 16:50:09.143799 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: agent.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.144714 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.145231 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: agent Sep 01 16:50:09.145583 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: agent_resources_synced.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.146579 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.147093 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: agent-resources-synced Sep 01 16:50:09.147425 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: allowedaddresspairs.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.149246 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.149813 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: allowed-address-pairs Sep 01 16:50:09.150569 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: auto_allocated_topology.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.151683 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.152204 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: auto-allocated-topology Sep 01 16:50:09.152566 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: availability_zone.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.153957 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.154477 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: availability_zone Sep 01 16:50:09.154812 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: availability_zone_filter.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.155747 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.156260 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: availability_zone_filter Sep 01 16:50:09.156591 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: data_plane_status.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.157550 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.158064 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension data-plane-status not supported by any of loaded plugins Sep 01 16:50:09.158392 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: default_subnetpools.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.159322 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.159863 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: default-subnetpools Sep 01 16:50:09.160237 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: dhcpagentscheduler.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.161065 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.161603 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: dhcp_agent_scheduler Sep 01 16:50:09.161938 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: dns.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.162884 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.163417 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension dns-integration not supported by any of loaded plugins Sep 01 16:50:09.163747 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: dns_domain_ports.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.164687 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.165198 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension dns-domain-ports not supported by any of loaded plugins Sep 01 16:50:09.165559 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.166509 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.167020 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Sep 01 16:50:09.167348 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: dvr.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.168034 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.168733 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: dvr Sep 01 16:50:09.169064 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: ecmp_routes.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.170031 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.170542 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension ecmp_routes not supported by any of loaded plugins Sep 01 16:50:09.170871 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: empty_string_filtering.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.171802 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.172315 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: empty-string-filtering Sep 01 16:50:09.172653 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.173690 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.174204 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Sep 01 16:50:09.174525 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.175463 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.175968 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Sep 01 16:50:09.176298 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: external_net.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.177234 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.177770 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: external-net Sep 01 16:50:09.178105 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: extra_dhcp_opt.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.179034 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.179550 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: extra_dhcp_opt Sep 01 16:50:09.179882 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: extraroute.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.180812 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.181325 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: extraroute Sep 01 16:50:09.181680 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: extraroute_atomic.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.182764 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.183280 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: extraroute-atomic Sep 01 16:50:09.183613 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: filter_validation.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.184325 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.184834 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: filter-validation Sep 01 16:50:09.185166 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: fip_pf_description.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.186131 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.186643 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Sep 01 16:50:09.186972 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: fip_port_details.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.187906 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.188420 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: fip-port-details Sep 01 16:50:09.188749 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: flavors.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.190025 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.190637 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: flavors Sep 01 16:50:09.190972 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.192665 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.193192 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Sep 01 16:50:09.193567 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: floatingip_pools.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.194283 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.194803 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: floatingip-pools Sep 01 16:50:09.195137 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: ip_allocation.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.196086 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.196598 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension ip_allocation not supported by any of loaded plugins Sep 01 16:50:09.196930 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: ip_substring_port_filtering.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.197992 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.198515 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: ip-substring-filtering Sep 01 16:50:09.198851 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: l2_adjacency.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.200402 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.200911 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension l2_adjacency not supported by any of loaded plugins Sep 01 16:50:09.201240 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: l3.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.202388 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.202923 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: router Sep 01 16:50:09.203256 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: l3_conntrack_helper.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.205543 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.206091 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension l3-conntrack-helper not supported by any of loaded plugins Sep 01 16:50:09.206428 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: l3_ext_gw_mode.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.207381 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.207901 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: ext-gw-mode Sep 01 16:50:09.208234 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: l3_ext_ha_mode.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.209173 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.209724 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: l3-ha Sep 01 16:50:09.210055 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: l3_flavors.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.210991 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.211509 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: l3-flavors Sep 01 16:50:09.211841 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.212780 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.213295 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: l3-port-ip-change-not-allowed Sep 01 16:50:09.213649 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: l3agentscheduler.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.214694 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.215852 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: l3_agent_scheduler Sep 01 16:50:09.216190 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: logging.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.217723 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.218255 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension logging not supported by any of loaded plugins Sep 01 16:50:09.218597 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: metering.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.219358 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.220011 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: metering Sep 01 16:50:09.220353 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.221501 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.222025 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: metering_source_and_destination_fields Sep 01 16:50:09.222362 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: multiprovidernet.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.223320 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.223835 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: multi-provider Sep 01 16:50:09.224167 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: netmtu.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.225109 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.225657 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: net-mtu Sep 01 16:50:09.225991 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: netmtu_writable.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.226927 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.227440 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: net-mtu-writable Sep 01 16:50:09.227772 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: network_availability_zone.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.228457 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.228968 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: network_availability_zone Sep 01 16:50:09.229299 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: network_ip_availability.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.230432 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.231053 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: network-ip-availability Sep 01 16:50:09.231392 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: network_segment_range.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.232172 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.232691 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension network-segment-range not supported by any of loaded plugins Sep 01 16:50:09.233021 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: pagination.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.234038 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.234377 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: pagination Sep 01 16:50:09.234705 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: port_device_profile.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.235696 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.236217 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: port-device-profile Sep 01 16:50:09.236547 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: port_mac_address_regenerate.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.237516 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.238041 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: port-mac-address-regenerate Sep 01 16:50:09.238373 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: port_numa_affinity_policy.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.239319 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.239837 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: port-numa-affinity-policy Sep 01 16:50:09.240170 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: port_resource_request.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.241100 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.241649 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension port-resource-request not supported by any of loaded plugins Sep 01 16:50:09.241999 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: portbindings.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.242946 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.243465 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: binding Sep 01 16:50:09.243821 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: portbindings_extended.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.245223 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.245781 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: binding-extended Sep 01 16:50:09.246119 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: portsecurity.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.247210 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.247730 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: port-security Sep 01 16:50:09.248064 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: project_id.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.249065 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.249426 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: project-id Sep 01 16:50:09.249763 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: providernet.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.250719 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.251307 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: provider Sep 01 16:50:09.251641 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: qos.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.255233 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.255766 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension qos not supported by any of loaded plugins Sep 01 16:50:09.256108 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: qos_bw_limit_direction.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.257373 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.257919 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Sep 01 16:50:09.258259 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.259210 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.259729 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Sep 01 16:50:09.260066 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: qos_default.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.261004 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.261547 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension qos-default not supported by any of loaded plugins Sep 01 16:50:09.261886 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: qos_fip.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.263477 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.264370 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension qos-fip not supported by any of loaded plugins Sep 01 16:50:09.264916 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: qos_gateway_ip.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.266121 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.266784 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension qos-gateway-ip not supported by any of loaded plugins Sep 01 16:50:09.267289 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: qos_port_network_policy.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.268541 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.269463 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension qos-port-network-policy not supported by any of loaded plugins Sep 01 16:50:09.269830 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: qos_pps_rule.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.271046 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.271586 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension qos-pps not supported by any of loaded plugins Sep 01 16:50:09.271923 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: qos_rule_type_details.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.272864 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.273422 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension qos-rule-type-details not supported by any of loaded plugins Sep 01 16:50:09.273752 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: qos_rules_alias.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.274818 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.275596 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension qos-rules-alias not supported by any of loaded plugins Sep 01 16:50:09.275928 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: quotasv2.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.276869 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.277205 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: quotas Sep 01 16:50:09.277602 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: quotasv2_detail.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.281267 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.281642 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: quota_details Sep 01 16:50:09.281984 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: rbac.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.283274 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.283811 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: rbac-policies Sep 01 16:50:09.284150 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: rbac_address_group.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.285102 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.285658 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: rbac-address-group Sep 01 16:50:09.285996 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: rbac_address_scope.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.286946 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.287627 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: rbac-address-scope Sep 01 16:50:09.287972 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: rbac_security_groups.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.288936 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.289486 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: rbac-security-groups Sep 01 16:50:09.289821 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: rbac_subnetpool.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.290762 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.291281 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: rbac-subnetpool Sep 01 16:50:09.291611 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: revisionifmatch.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.292553 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.293085 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: revision-if-match Sep 01 16:50:09.293606 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: revisions.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.294750 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.295270 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: standard-attr-revisions Sep 01 16:50:09.295606 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: router_availability_zone.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.296303 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.296819 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: router_availability_zone Sep 01 16:50:09.297152 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: routerservicetype.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.298195 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.298725 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension router-service-type not supported by any of loaded plugins Sep 01 16:50:09.299057 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.300005 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.300526 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: security-groups-normalized-cidr Sep 01 16:50:09.300857 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: security_groups_port_filtering.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.301831 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.302357 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: port-security-groups-filtering Sep 01 16:50:09.302691 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: security_groups_remote_address_group.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.303647 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.304173 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: security-groups-remote-address-group Sep 01 16:50:09.304507 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: securitygroup.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.314148 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.314688 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: security-group Sep 01 16:50:09.315030 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: segment.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.315838 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.316358 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension segment not supported by any of loaded plugins Sep 01 16:50:09.316697 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.317683 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.318204 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Sep 01 16:50:09.318541 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: servicetype.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.319746 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.320274 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: service-type Sep 01 16:50:09.320617 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: sorting.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.321657 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.322006 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: sorting Sep 01 16:50:09.322342 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: standard_attr_segment.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.323284 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.323810 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension standard-attr-segment not supported by any of loaded plugins Sep 01 16:50:09.324148 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: standardattrdescription.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.325431 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.325953 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: standard-attr-description Sep 01 16:50:09.326284 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: stateful_security_group.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.327240 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.327766 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: stateful-security-group Sep 01 16:50:09.328104 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: stdattrs_common.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.328705 dv-cinder-799668-16-iscsi neutron-server[93726]: WARNING neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Sep 01 16:50:09.329038 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.330045 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.330570 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Sep 01 16:50:09.330901 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: subnet_onboard.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.332163 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.332692 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: subnet_onboard Sep 01 16:50:09.333032 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: subnet_segmentid_writable.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.334020 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.334538 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Sep 01 16:50:09.334868 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: subnet_service_types.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.335826 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.336351 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: subnet-service-types Sep 01 16:50:09.336681 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: subnetallocation.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.337828 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.338331 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: subnet_allocation Sep 01 16:50:09.338666 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.339354 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.339866 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: subnetpool-prefix-ops Sep 01 16:50:09.340805 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.341797 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.342314 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Sep 01 16:50:09.342646 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: tagging.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.343739 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.344262 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: standard-attr-tag Sep 01 16:50:09.344599 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: timestamp.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.345851 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.346375 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loaded extension: standard-attr-timestamp Sep 01 16:50:09.346712 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: trunk.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.347766 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.348292 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension trunk not supported by any of loaded plugins Sep 01 16:50:09.348630 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: trunk_details.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.349609 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.350137 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension trunk-details not supported by any of loaded plugins Sep 01 16:50:09.350473 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: uplink_status_propagation.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.351415 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.351938 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension uplink-status-propagation not supported by any of loaded plugins Sep 01 16:50:09.352270 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Loading extension file: vlantransparent.py {{(pid=93726) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 01 16:50:09.352964 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=93726) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 01 16:50:09.353510 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extension vlan-transparent not supported by any of loaded plugins Sep 01 16:50:09.356032 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:network Sep 01 16:50:09.356585 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:subnet Sep 01 16:50:09.356990 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:subnetpool Sep 01 16:50:09.357417 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:port Sep 01 16:50:09.358670 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.v2.resource_helper [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=93726) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 01 16:50:09.359116 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.v2.resource_helper [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service FLAVORS assigned prefix: {{(pid=93726) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 01 16:50:09.359753 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.v2.resource_helper [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=93726) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 01 16:50:09.360189 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.v2.resource_helper [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=93726) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 01 16:50:09.360529 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:router Sep 01 16:50:09.360974 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:floatingip Sep 01 16:50:09.361518 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.v2.resource_helper [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service METERING assigned prefix: /metering {{(pid=93726) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 01 16:50:09.362978 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.363354 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.363715 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=93726) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:50:09.364748 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of CountableResource for resource:rbac_policy Sep 01 16:50:09.365211 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:security_group Sep 01 16:50:09.365683 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:security_group_rule Sep 01 16:50:09.367439 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.v2.resource_helper [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service CORE assigned prefix: {{(pid=93726) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 01 16:50:09.367783 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:subnetpool Sep 01 16:50:09.368184 dv-cinder-799668-16-iscsi neutron-server[93726]: WARNING neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] subnetpool is already registered Sep 01 16:50:09.368577 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.v2.resource_helper [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service CORE assigned prefix: {{(pid=93726) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 01 16:50:09.368913 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:subnetpool Sep 01 16:50:09.369288 dv-cinder-799668-16-iscsi neutron-server[93726]: WARNING neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] subnetpool is already registered Sep 01 16:50:09.371617 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.v2.resource_helper [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=93726) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 01 16:50:09.372063 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.v2.resource_helper [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service FLAVORS assigned prefix: {{(pid=93726) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 01 16:50:09.372666 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.v2.resource_helper [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=93726) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 01 16:50:09.373104 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.v2.resource_helper [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=93726) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 01 16:50:09.373470 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:router Sep 01 16:50:09.373819 dv-cinder-799668-16-iscsi neutron-server[93726]: WARNING neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] router is already registered Sep 01 16:50:09.374240 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:floatingip Sep 01 16:50:09.374586 dv-cinder-799668-16-iscsi neutron-server[93726]: WARNING neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] floatingip is already registered Sep 01 16:50:09.375048 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.v2.resource_helper [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service METERING assigned prefix: /metering {{(pid=93726) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 01 16:50:09.375728 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of CountableResource for resource:rbac_policy Sep 01 16:50:09.376066 dv-cinder-799668-16-iscsi neutron-server[93726]: WARNING neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] rbac_policy is already registered Sep 01 16:50:09.376486 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:security_group Sep 01 16:50:09.376830 dv-cinder-799668-16-iscsi neutron-server[93726]: WARNING neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] security_group is already registered Sep 01 16:50:09.377241 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:security_group_rule Sep 01 16:50:09.377680 dv-cinder-799668-16-iscsi neutron-server[93726]: WARNING neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] security_group_rule is already registered Sep 01 16:50:09.378305 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.v2.resource_helper [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service CORE assigned prefix: {{(pid=93726) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 01 16:50:09.378642 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:subnetpool Sep 01 16:50:09.378981 dv-cinder-799668-16-iscsi neutron-server[93726]: WARNING neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] subnetpool is already registered Sep 01 16:50:09.379406 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.v2.resource_helper [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Service CORE assigned prefix: {{(pid=93726) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 01 16:50:09.379744 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Creating instance of TrackedResource for resource:subnetpool Sep 01 16:50:09.380081 dv-cinder-799668-16-iscsi neutron-server[93726]: WARNING neutron.quota.resource_registry [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] subnetpool is already registered Sep 01 16:50:09.380552 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: extensions {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.382069 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: address-groups {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.383592 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: address-scopes {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.384912 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: agents {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.386177 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: auto-allocated-topology {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.388113 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: availability_zones {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.389356 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: dhcp-networks {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.390941 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: dhcp-agents {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.392405 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: routers {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.394862 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: flavors {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.396034 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: service_profiles {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.397273 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: next_providers {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.398752 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: service_profiles {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.400657 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: floatingip-pools {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.401933 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: routers {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.404838 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: floatingips {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.406168 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: l3-routers {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.407563 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: l3-agents {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.408969 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: metering-labels {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.410413 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: metering-label-rules {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.411710 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: network-ip-availabilities {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.412985 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: bindings {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.414689 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: quotas {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.416154 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: quotas {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.417622 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: rbac-policies {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.419178 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: security-groups {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.420507 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: security-group-rules {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.421771 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: service-providers {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.423005 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: subnetpools {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.424454 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: subnetpools {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.426098 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: tags {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.427779 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: tags {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.429606 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: tags {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.431410 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: tags {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.434377 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: tags {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.436271 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: tags {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.438002 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: tags {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.439916 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: tags {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.441728 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: tags {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.443493 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron.api.extensions [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Extended resource: tags {{(pid=93726) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 01 16:50:09.449968 dv-cinder-799668-16-iscsi neutron-server[93726]: WARNING keystonemiddleware.auth_token [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:50:09.454728 dv-cinder-799668-16-iscsi neutron-server[93726]: WARNING keystonemiddleware.auth_token [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:50:09.462998 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_concurrency.lockutils [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Acquired lock "singleton_lock" {{(pid=93726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 01 16:50:09.463495 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_concurrency.lockutils [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Releasing lock "singleton_lock" {{(pid=93726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 01 16:50:09.464151 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO oslo_service.service [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Starting 2 workers Sep 01 16:50:09.469644 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Started child 93835 {{(pid=93726) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 01 16:50:09.474088 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Started child 93836 {{(pid=93726) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 01 16:50:09.475053 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:09.475880 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO neutron.service [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Neutron service started, listening on 0.0.0.0:9696 Sep 01 16:50:09.476317 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Notify callbacks [] for process, before_spawn {{(pid=93726) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:09.476567 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [-] (93835) wsgi starting up on http://0.0.0.0:9696 Sep 01 16:50:09.478747 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO oslo_service.service [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Starting 1 workers Sep 01 16:50:09.478905 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:09.480118 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [-] (93836) wsgi starting up on http://0.0.0.0:9696 Sep 01 16:50:09.484051 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Started child 93837 {{(pid=93726) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 01 16:50:09.484590 dv-cinder-799668-16-iscsi neutron-server[93726]: INFO oslo_service.service [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Starting 1 workers Sep 01 16:50:09.487796 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.service [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] calling RpcWorker wait() {{(pid=93837) _wait /opt/stack/neutron/neutron/service.py:128}} Sep 01 16:50:09.488324 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.service [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] returning from RpcWorker wait() {{(pid=93837) _wait /opt/stack/neutron/neutron/service.py:135}} Sep 01 16:50:09.489065 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Started child 93838 {{(pid=93726) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 01 16:50:09.489732 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:09.489922 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG neutron_lib.callbacks.manager [None req-cd3bf199-d698-4e47-a3bb-791c907427ce None None] Notify callbacks [] for process, after_spawn {{(pid=93726) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:09.490303 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:50:09.491774 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=93726) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Sep 01 16:50:09.491995 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:50:09.492186 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:50:09.492409 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:50:09.492752 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:50:09.492920 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:50:09.493446 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.493734 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.493993 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.494123 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:09.494570 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.494570 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.495147 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:50:09.495249 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.495413 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.495672 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.495961 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.496205 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.497232 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.497232 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.497407 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.497605 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.497923 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.498193 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.498437 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.498711 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.498891 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.499144 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] config_source = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.499424 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.499678 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.499959 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] debug = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.500314 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.500840 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.501075 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.501324 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.501592 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.501883 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.502118 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.502390 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.502645 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.502866 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.503107 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.503378 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.503619 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.503843 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.504084 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.504348 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.504606 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.505072 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] host = dv-cinder-799668-16-iscsi {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.505316 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.505578 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.505833 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.506068 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.506334 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.506586 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.506858 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.507124 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.507380 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.507615 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.507882 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.508127 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.508369 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_dir = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.508623 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_file = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.508792 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_options = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.509014 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.509285 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.509585 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.509781 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.509956 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.510139 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.510403 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.510571 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.510819 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.511040 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.511258 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.511499 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.511717 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.512023 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.512848 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.513111 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.513366 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.513755 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.513894 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.514087 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.514322 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.514559 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.514786 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.515014 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.515232 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.515451 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.515682 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.515935 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.516153 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.516417 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.516654 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.516906 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.517156 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.517447 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.517681 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.517917 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.518135 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.518409 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.518646 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.518911 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.519172 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.519413 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.519659 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.519899 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.520147 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] use_journal = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.520386 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] use_json = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.520603 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.520818 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.521079 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.521297 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.521571 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.521789 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.522006 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.522246 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.522707 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.522997 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.523312 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.523558 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.523813 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.524067 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.524307 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.524551 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.524806 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.525058 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.526913 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.527174 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.529506 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.529824 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.532473 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.532473 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.532473 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.532473 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.532473 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.532473 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.532473 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.532473 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.533132 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.533132 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.533132 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.533132 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.533415 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.534291 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.534590 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.534880 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.67/identity {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.535672 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.537518 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.537818 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.538070 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.538742 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.538742 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.539012 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.539150 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.539370 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.539530 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.539761 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.541581 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.541581 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.541581 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.541581 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.541581 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.541581 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.541581 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.542570 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.542570 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.542570 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.542570 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.542570 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.542863 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.544410 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.544410 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.544410 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.544410 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.544410 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.544410 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.544410 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.544859 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.544859 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.544989 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.545276 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.545617 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.545945 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.546175 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.546397 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.546644 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.546859 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.547289 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.547534 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.547768 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.547990 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.548364 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.548465 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.548629 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.548882 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.549121 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.549344 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.549607 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.549836 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.550073 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.550309 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.550526 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.550746 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.550962 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.551182 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.551459 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.551938 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.552387 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.552783 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.553161 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.553462 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.553723 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.553961 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.554371 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.554739 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.555176 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.555589 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.555991 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.556265 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.556502 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.556742 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.557230 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.557490 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.557746 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.557993 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.558255 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.558504 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.559282 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.559725 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.560231 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.560673 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.561070 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.561500 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.561903 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.562332 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.562562 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.562850 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.563179 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.563459 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.563733 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.563995 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.564255 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.564508 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.564744 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.564998 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.565240 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.565510 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.565754 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.566040 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.566279 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.566506 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.566729 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.566963 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.567329 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.567567 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.567786 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.568001 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.568281 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.568540 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.568799 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.569067 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.569317 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.569585 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.569849 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.570081 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.67/identity {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.570316 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.570561 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.570794 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.571012 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.571248 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.571465 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.571703 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.571943 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.572176 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.572428 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.572644 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.572866 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.573116 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.573339 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.573581 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.573829 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.574040 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.574277 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.576485 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.576485 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.576485 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.576485 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.576485 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.576485 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.576485 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.577012 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.577012 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.577266 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.577555 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.577787 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.578045 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.578266 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.578520 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.578742 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.578965 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.579234 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.579413 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.579626 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.579842 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.580093 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.580340 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.580612 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.580853 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.581198 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.581463 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.581694 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.582104 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.582362 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.582588 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.582847 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.583070 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.583315 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.583541 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.583784 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.584048 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.584289 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.584670 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.584892 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.585111 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.585363 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.585609 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.585825 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.586110 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.586371 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.586627 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.586902 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.587140 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.587378 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.587607 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.587821 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.588031 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.588255 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.588495 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.588703 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.588947 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.589163 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.589379 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.589647 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.589862 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.590623 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.590861 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.591076 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.591328 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.591550 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.591767 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.592000 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.592225 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.592439 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.592652 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.592876 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.593095 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.593306 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.593578 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.593795 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.594007 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.594230 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.594466 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.594664 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.594987 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.595254 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.595470 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.595767 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.596019 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.596266 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.596509 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.596817 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.597034 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.597273 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.597542 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.597763 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.597983 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.598239 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.598543 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.598840 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.599097 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.599355 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.599617 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.599901 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:500:549'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.600178 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.600410 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.600732 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.601080 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.601359 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.601658 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.601894 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.602144 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.602368 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.602606 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.602846 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.603097 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.603330 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.603588 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.603818 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.604042 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.604277 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.604506 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.604727 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.604954 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.605197 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.605466 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.605761 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.605925 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:50:09.606499 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=93726) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Sep 01 16:50:09.606662 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:50:09.606818 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:50:09.607540 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:50:09.607540 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:50:09.607540 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:50:09.607540 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.607896 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.607896 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.608087 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.608166 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.608322 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.608489 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.608682 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.608789 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.608955 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.609110 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.609450 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.609618 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.609776 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.609937 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.610096 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.610259 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.610423 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.610586 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.610749 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] config_source = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.610905 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.611063 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.611225 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] debug = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.611385 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.611592 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.611753 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.611916 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.612078 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.612255 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.612391 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.612548 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.612707 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.612865 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.613912 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.613912 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.613912 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.613912 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.613912 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.613912 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.613912 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.614434 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] host = dv-cinder-799668-16-iscsi {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.614434 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.614434 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.614639 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.614726 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.614836 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.614962 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.615123 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.615288 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.615444 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.615602 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.615762 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.615922 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.616081 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_dir = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.616242 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_file = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.616400 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_options = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.616563 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.616720 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.616880 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.617072 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.617239 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.617437 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.617568 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.617728 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.617871 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.618036 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.618246 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.618384 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.618509 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.618652 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.618812 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.618972 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.619130 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.619288 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.619447 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.619612 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.619771 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.619929 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.620087 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.620246 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.620404 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.620564 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.620722 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.620882 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.621094 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.621219 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.621886 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.622103 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.622308 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.622471 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.622633 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.622794 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.622954 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.623118 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.623278 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.623437 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.623597 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.623758 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.623919 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.624079 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.624238 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] use_journal = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.624397 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] use_json = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.624556 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.624716 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.624875 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.625036 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.625195 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.625356 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.625539 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.625700 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:50:09.625881 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.626046 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.626219 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.626583 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.626745 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.626870 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.627068 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.627670 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.627670 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.627670 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.628363 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.628363 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.628363 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.628363 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.628695 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.628783 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.629008 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.629191 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.629320 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.629711 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.629884 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.630014 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:50:09.630157 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.630541 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.630541 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.631508 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.631508 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.631508 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.631508 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.631508 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.631508 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.67/identity {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.632421 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.632421 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.632421 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.632421 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.632421 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.633000 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.633000 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.633585 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.633585 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.633585 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.634053 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.634053 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.634053 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.634412 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.634412 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.634874 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.634874 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.634874 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.635267 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.635267 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.635623 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.635623 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.636321 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.636321 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.636321 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.636321 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.636321 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.638297 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.638297 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.638297 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.638297 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.638297 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.638297 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.638297 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.638297 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.639363 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.639363 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.639363 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.639363 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.639363 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.639363 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.640116 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.640116 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.640116 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.640116 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.640116 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.640644 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.640644 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.640644 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.640644 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.641194 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.641194 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.641575 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.641575 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.641988 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.641988 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.641988 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.642319 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.642319 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.642527 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.642632 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.642870 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.642999 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.643134 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.643480 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.643618 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.643845 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.643845 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.644078 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.644191 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.644305 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.644530 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.644674 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.645097 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.645376 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.645700 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.645906 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.646181 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.646361 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.646532 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.646699 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.647516 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.647516 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.647516 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.647516 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.647516 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.648283 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.648283 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.648283 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.648283 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.648283 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.648863 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.648863 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.648863 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.649213 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.649213 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.649213 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.649656 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.649656 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.649656 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.650019 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.650019 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.650618 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.650618 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.650854 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.650977 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.651100 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.651222 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.651354 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.651567 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.651694 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.651817 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.651972 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.652139 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.652302 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.652472 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.652861 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.653015 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.653179 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.67/identity {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.653347 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.653561 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.653718 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.654154 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.654154 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.654476 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.654476 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.654725 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.654838 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.654944 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.655132 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.655244 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.655458 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.655733 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.655733 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.656074 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.656074 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.656346 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.656346 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.656557 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.656668 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.656896 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.657164 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.657305 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.657551 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.657551 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.657917 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.657917 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.658243 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.658243 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.658465 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.658590 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.658945 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.658945 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.659310 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.659310 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.659310 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.659790 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.659790 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.660081 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.660081 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.660286 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.660286 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.660513 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.660621 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.660905 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.661116 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.661245 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.661492 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.661734 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.661850 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.662007 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.662160 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.662320 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.662597 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.662767 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.662986 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.663102 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.663339 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.663467 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.663591 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.663725 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.663881 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.664045 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.664209 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.664373 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.664538 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.664701 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.664875 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.665039 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.665203 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.665365 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.665565 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.665729 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.665903 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.666066 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.666229 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.666391 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.666569 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.666706 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.666872 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.667034 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.667197 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.667361 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.667524 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.667676 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.667846 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.668009 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.668246 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.668376 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.668490 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.668645 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.668819 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.668983 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.669146 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.669441 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.669578 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.669718 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.669886 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.670034 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.670198 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.670369 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.670531 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.670693 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.670855 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.671031 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.671195 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.671361 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.671523 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.671735 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.671866 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.671991 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.672144 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.672317 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.672486 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.672651 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.672822 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.672994 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:500:549'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.673166 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.673329 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.673518 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.673694 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.673857 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.674020 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.674184 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.674347 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.674511 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.674673 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.674836 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.674999 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.675163 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.675327 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.675491 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.675654 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.675816 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.675978 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.676147 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.676309 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.676473 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.676709 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.676875 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:50:09.677029 dv-cinder-799668-16-iscsi neutron-server[93726]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=93726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:50:09.837463 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 48784) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:50:09.846626 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [-] 10.222.0.67 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0068989 Sep 01 16:50:21.333215 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e303dcd-7e76-4895-9e79-a82a05f9c8b1 None None] get_active_networks_info from dv-cinder-799668-16-iscsi {{(pid=93837) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Sep 01 16:50:21.414243 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e303dcd-7e76-4895-9e79-a82a05f9c8b1 None None] No non-hosted networks {{(pid=93837) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Sep 01 16:50:21.422251 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-abf0a57f-1ef9-4169-a221-114d8b960e3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1832696'] for agent, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:23.836740 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-b22eec27-bcab-4b48-bf7f-478be669be50 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1832696'] for agent, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:23.838055 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1832696'] for agent, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:23.838689 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:23.839193 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:23.840299 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:23.840929 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:23.842132 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:23.843314 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:23.843818 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:23.844316 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:23.844788 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:23.845265 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:23.845793 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:23.846479 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:23.847034 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-799668-16-iscsi', {'QosPolicy': '1.9', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:50:23.870229 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-05021d79-079d-4781-8946-89de6f343e09 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:23.921047 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-799668-16-iscsi', 'version_map': {'QosPolicy': '1.9', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:50:24.878342 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1832696'] for agent, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:26.496632 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1832696'] for agent, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:28.001047 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 48882) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:50:28.191382 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.db.l3_hamode_db [None req-9d6f44a4-4a66-4ef8-ae2d-36ff38354bda None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Sep 01 16:50:28.270811 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d6f44a4-4a66-4ef8-ae2d-36ff38354bda None None] Routers set() bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:50:28.271208 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d6f44a4-4a66-4ef8-ae2d-36ff38354bda None None] Router IDs set() for agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Sep 01 16:50:28.503875 dv-cinder-799668-16-iscsi neutron-server[93835]: WARNING oslo_policy.policy [None req-ca96d835-f122-441e-a69c-206113176e62 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 01 16:50:28.504478 dv-cinder-799668-16-iscsi neutron-server[93835]: WARNING oslo_policy.policy [None req-ca96d835-f122-441e-a69c-206113176e62 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 01 16:50:28.723735 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [None req-ca96d835-f122-441e-a69c-206113176e62 admin admin] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93835) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 16:50:28.725003 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-ca96d835-f122-441e-a69c-206113176e62 admin admin] 10.222.0.67 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.7218490 Sep 01 16:50:31.111355 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 48896) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:50:31.600128 dv-cinder-799668-16-iscsi neutron-server[93836]: WARNING oslo_policy.policy [None req-308fab39-c93c-4d5a-b262-21a6dff4c9c1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 01 16:50:31.600719 dv-cinder-799668-16-iscsi neutron-server[93836]: WARNING oslo_policy.policy [None req-308fab39-c93c-4d5a-b262-21a6dff4c9c1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 01 16:50:31.820666 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-308fab39-c93c-4d5a-b262-21a6dff4c9c1 admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'name': 'shared-default-subnetpool-v4', 'default_prefixlen': 26, 'is_default': True, 'shared': True}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:50:31.913256 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.policy [None req-308fab39-c93c-4d5a-b262-21a6dff4c9c1 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=93836) register_rules /opt/stack/neutron/neutron/policy.py:73}} Sep 01 16:50:31.957169 dv-cinder-799668-16-iscsi neutron-server[93836]: WARNING oslo_policy.policy [None req-308fab39-c93c-4d5a-b262-21a6dff4c9c1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 01 16:50:31.957563 dv-cinder-799668-16-iscsi neutron-server[93836]: WARNING oslo_policy.policy [None req-308fab39-c93c-4d5a-b262-21a6dff4c9c1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 01 16:50:31.966491 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.quota [None req-308fab39-c93c-4d5a-b262-21a6dff4c9c1 admin admin] Loaded quota_driver: . Sep 01 16:50:32.055091 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-308fab39-c93c-4d5a-b262-21a6dff4c9c1 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8748411303964', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8748411305457', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8748411308891', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8748411307519', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8748411859614', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8748411269525', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-637415', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-672960', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1814707', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1614691'] for rbac-policy, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:32.118116 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-308fab39-c93c-4d5a-b262-21a6dff4c9c1 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:32.119400 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-308fab39-c93c-4d5a-b262-21a6dff4c9c1 admin admin] 10.222.0.67 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 1.0070784 Sep 01 16:50:34.723690 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 48914) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:50:35.019753 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Request body: {'network': {'project_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'admin_state_up': True, 'name': 'private', 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:50:35.049482 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Made reservation on behalf of 7bf15fe9f7d34f029054dbc18d5c4c7a for: {'network': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:50:35.052247 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:35.068996 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:35.191448 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:35.195119 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:35.213971 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] vlan segment allocate from pool success with {'vlan_id': 538, 'physical_network': 'physnet1'} {{(pid=93836) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 16:50:35.242041 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8748409195722', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:35.242607 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Unsubscribe: segment precommit_create {{(pid=93836) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Sep 01 16:50:35.243101 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.segments_db [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Added segment f94ec7af-9f00-4e9b-a436-e9fef1d181e9 of type vlan for network 2fa7ae8c-5777-41e0-a6ca-6640bd1daec6 Sep 01 16:50:35.258846 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7bc84099-b214-4297-8e90-2f353a814f0e,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:50:35.285678 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:35.286036 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:35.286376 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:35.286703 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:35.287026 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:35.287682 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:35.288014 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:35.288351 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:35.288704 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:35.289008 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:35.289323 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:35.289662 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Tracked resource versions report: Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: pushed versions: Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: { 'AddressGroup': {'1.2'}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'ConntrackHelper': {'1.0'}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Log': {'1.0'}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Network': {'1.1'}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Port': {'1.7'}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'PortForwarding': {'1.2'}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'QosPolicy': {'1.9'}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'SecurityGroup': {'1.4'}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'SecurityGroupRule': {'1.2'}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'SubPort': {'1.0'}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Subnet': {'1.1'}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Trunk': {'1.1'}} Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: consumer versions: Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: { DHCP agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: L3 agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: Metadata agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: Metering agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: Open vSwitch agent@dv-cinder-799668-16-iscsi: { 'AddressGroup': '1.2', Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'ConntrackHelper': '1.0', Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Log': '1.0', Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Network': '1.1', Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Port': '1.7', Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'PortForwarding': '1.2', Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'QosPolicy': '1.9', Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'SecurityGroup': '1.4', Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'SecurityGroupRule': '1.2', Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'SubPort': '1.0', Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Subnet': '1.1', Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Trunk': '1.1'}} Sep 01 16:50:35.290980 dv-cinder-799668-16-iscsi neutron-server[93836]: {{(pid=93836) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 01 16:50:35.364660 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:35.403148 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:35.404268 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:50:35.404947 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:35.474753 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.7496550 Sep 01 16:50:35.504160 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27c4be09-b000-49a3-b0d4-93d434462005 admin admin] Pushing event updated for resources: {'Network': ['ID=2fa7ae8c-5777-41e0-a6ca-6640bd1daec6,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:50:35.516885 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network 2fa7ae8c-5777-41e0-a6ca-6640bd1daec6 details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 16:50:38.146974 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 48928) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:50:38.544986 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d2944243-617f-44fb-aee8-2d6d7f32489a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:50:38.546416 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-d2944243-617f-44fb-aee8-2d6d7f32489a admin admin] 10.222.0.67 "GET /v2.0/networks/2fa7ae8c-5777-41e0-a6ca-6640bd1daec6 HTTP/1.1" status: 200 len: 825 time: 0.3984878 Sep 01 16:50:38.570773 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-dbf699b5-863a-4a57-8b81-02204712fe34 admin admin] 10.222.0.67 "GET /v2.0/subnetpools/f47e5704-c992-45b3-8b07-caa32197cfee HTTP/1.1" status: 200 len: 734 time: 0.0181432 Sep 01 16:50:38.580301 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-035d0e01-3968-4543-96a0-7fb492272c3d admin admin] Request body: {'subnet': {'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6', 'gateway_ip': '172.20.0.1', 'subnetpool_id': 'f47e5704-c992-45b3-8b07-caa32197cfee', 'name': 'private-subnet', 'ip_version': 4, 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:50:38.602267 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-035d0e01-3968-4543-96a0-7fb492272c3d admin admin] Made reservation on behalf of 7bf15fe9f7d34f029054dbc18d5c4c7a for: {'subnet': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:50:38.604485 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-035d0e01-3968-4543-96a0-7fb492272c3d admin admin] Notify callbacks [] for subnet, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:38.891515 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-035d0e01-3968-4543-96a0-7fb492272c3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for subnet, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:38.959761 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-035d0e01-3968-4543-96a0-7fb492272c3d admin admin] Checking segment: {'id': 'f94ec7af-9f00-4e9b-a436-e9fef1d181e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93836) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:50:38.960148 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-035d0e01-3968-4543-96a0-7fb492272c3d admin admin] Network hostable DHCP agents. Network: 2fa7ae8c-5777-41e0-a6ca-6640bd1daec6, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93836) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 16:50:38.965680 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035d0e01-3968-4543-96a0-7fb492272c3d admin admin] Pushing event updated for resources: {'Subnet': ['ID=8342f334-c8a1-41cf-816c-e3f965162160,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:50:38.985868 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-035d0e01-3968-4543-96a0-7fb492272c3d admin admin] Network 2fa7ae8c-5777-41e0-a6ca-6640bd1daec6 is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93836) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 16:50:39.000093 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-035d0e01-3968-4543-96a0-7fb492272c3d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, 2fa7ae8c-5777-41e0-a6ca-6640bd1daec6) {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:50:39.006113 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-035d0e01-3968-4543-96a0-7fb492272c3d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:50:39.007695 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-035d0e01-3968-4543-96a0-7fb492272c3d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:39.009131 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cb964fa-a5c0-4945-a065-a52879288da7 None None] Network 2fa7ae8c-5777-41e0-a6ca-6640bd1daec6 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:50:39.021845 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-035d0e01-3968-4543-96a0-7fb492272c3d admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4448717 Sep 01 16:50:39.334067 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ce91fdb-f9d4-529e-8715-29775a2007ca-2fa7ae8c-5777-41e0-a6ca-6640bd1daec6', 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6', 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'fixed_ips': [{'subnet_id': '8342f334-c8a1-41cf-816c-e3f965162160'}]}} from dv-cinder-799668-16-iscsi. {{(pid=93837) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 01 16:50:39.335277 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:39.606350 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.db_base_plugin_common [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Allocated IP 172.20.0.2 (2fa7ae8c-5777-41e0-a6ca-6640bd1daec6/8342f334-c8a1-41cf-816c-e3f965162160/08f0c39e-0abc-4493-a5a4-9a5a01c8d173) {{(pid=93837) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:50:39.812017 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Notify callbacks [] for port, precommit_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:39.854720 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Transition to ACTIVE for port object 08f0c39e-0abc-4493-a5a4-9a5a01c8d173 will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:50:39.875432 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Transition to ACTIVE for port object 08f0c39e-0abc-4493-a5a4-9a5a01c8d173 will not be triggered until provisioned by entity DHCP. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:50:39.882546 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:39.950651 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Network 2fa7ae8c-5777-41e0-a6ca-6640bd1daec6 is already hosted by enough agents. {{(pid=93837) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:50:39.957295 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.base_scheduler [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Resources bound (agent type, host, resource id): {{(pid=93837) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:50:39.969453 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Received port after_create {{(pid=93837) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:50:39.976568 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Pushing event updated for resources: {'Port': ['ID=08f0c39e-0abc-4493-a5a4-9a5a01c8d173,revision_number=1']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:50:40.005616 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:40.005988 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:40.006337 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:40.006675 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:40.007011 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:40.007343 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:40.007673 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:40.008002 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:40.008344 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:40.008672 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:40.008997 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:40.009322 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Tracked resource versions report: Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: pushed versions: Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: { 'AddressGroup': {'1.2'}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'ConntrackHelper': {'1.0'}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Log': {'1.0'}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Network': {'1.1'}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Port': {'1.7'}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'PortForwarding': {'1.2'}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'QosPolicy': {'1.9'}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'SecurityGroup': {'1.4'}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'SecurityGroupRule': {'1.2'}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'SubPort': {'1.0'}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Subnet': {'1.1'}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Trunk': {'1.1'}} Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: consumer versions: Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: { DHCP agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: L3 agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: Metadata agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: Metering agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: Open vSwitch agent@dv-cinder-799668-16-iscsi: { 'AddressGroup': '1.2', Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'ConntrackHelper': '1.0', Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Log': '1.0', Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Network': '1.1', Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Port': '1.7', Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'PortForwarding': '1.2', Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'QosPolicy': '1.9', Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'SecurityGroup': '1.4', Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'SecurityGroupRule': '1.2', Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'SubPort': '1.0', Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Subnet': '1.1', Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Trunk': '1.1'}} Sep 01 16:50:40.010689 dv-cinder-799668-16-iscsi neutron-server[93837]: {{(pid=93837) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 01 16:50:40.057636 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Attempting to bind port 08f0c39e-0abc-4493-a5a4-9a5a01c8d173 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:50:40.058607 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Attempting to bind port 08f0c39e-0abc-4493-a5a4-9a5a01c8d173 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': 'f94ec7af-9f00-4e9b-a436-e9fef1d181e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:50:40.059041 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Attempting to bind port 08f0c39e-0abc-4493-a5a4-9a5a01c8d173 on network 2fa7ae8c-5777-41e0-a6ca-6640bd1daec6 {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:50:40.063847 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 50, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:50:40.064269 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Checking segment: {'id': 'f94ec7af-9f00-4e9b-a436-e9fef1d181e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:50:40.064751 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:40.065145 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Bound using segment: {'id': 'f94ec7af-9f00-4e9b-a436-e9fef1d181e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:50:40.065673 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Bound port: 08f0c39e-0abc-4493-a5a4-9a5a01c8d173, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f94ec7af-9f00-4e9b-a436-e9fef1d181e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:50:40.066084 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:40.127672 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] For port 08f0c39e-0abc-4493-a5a4-9a5a01c8d173, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:50:40.131986 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] For port 08f0c39e-0abc-4493-a5a4-9a5a01c8d173, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=08f0c39e-0abc-4493-a5a4-9a5a01c8d173,segment=NetworkSegment(f94ec7af-9f00-4e9b-a436-e9fef1d181e9),segment_id=f94ec7af-9f00-4e9b-a436-e9fef1d181e9)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:50:40.135561 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:40.207951 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86d896b1-9021-4c52-a6fb-fe2cbe6d4400 None None] Pushing event updated for resources: {'Port': ['ID=08f0c39e-0abc-4493-a5a4-9a5a01c8d173,revision_number=2']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:50:41.523394 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 48936) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:50:41.845743 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [None req-c36bf5b2-1dbf-4bd3-b85c-1c1291438b48 admin admin] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93836) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 16:50:41.846833 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c36bf5b2-1dbf-4bd3-b85c-1c1291438b48 admin admin] 10.222.0.67 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3224118 Sep 01 16:50:44.272145 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 48944) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:50:44.604872 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [None req-479b048b-42bc-4cd1-bea3-dc9dfbb24d3c admin admin] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93836) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 16:50:44.606313 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-479b048b-42bc-4cd1-bea3-dc9dfbb24d3c admin admin] 10.222.0.67 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3331351 Sep 01 16:50:47.364002 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 48954) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:50:47.693429 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-31ba5662-ed7d-4072-9a53-2f527f76f6ab admin admin] Request body: {'router': {'name': 'router1', 'admin_state_up': True, 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:50:47.718546 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-31ba5662-ed7d-4072-9a53-2f527f76f6ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1827089', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4631'] for router, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:47.719304 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-31ba5662-ed7d-4072-9a53-2f527f76f6ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1833975', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1833092', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1830247', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4608'] for router, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:47.862759 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-31ba5662-ed7d-4072-9a53-2f527f76f6ab admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:47.868995 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-31ba5662-ed7d-4072-9a53-2f527f76f6ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1833934', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1833207'] for router, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:47.886275 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-31ba5662-ed7d-4072-9a53-2f527f76f6ab admin admin] Notify callbacks [] for router, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:47.889908 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-31ba5662-ed7d-4072-9a53-2f527f76f6ab admin admin] 10.222.0.67 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5247629 Sep 01 16:50:47.916558 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 08f0c39e-0abc-4493-a5a4-9a5a01c8d173 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:50:48.009285 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 08f0c39e-0abc-4493-a5a4-9a5a01c8d173 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:50:48.707862 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80789af6-477d-442c-b9c2-15b41bfc613a None None] Network 2fa7ae8c-5777-41e0-a6ca-6640bd1daec6 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:50:48.763953 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-cc3d3492-a018-4da8-b515-c975f0959650 None None] Provisioning for port 08f0c39e-0abc-4493-a5a4-9a5a01c8d173 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:50:48.771206 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-cc3d3492-a018-4da8-b515-c975f0959650 None None] Provisioning complete for port 08f0c39e-0abc-4493-a5a4-9a5a01c8d173 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:50:48.771596 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-cc3d3492-a018-4da8-b515-c975f0959650 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:48.934680 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-cc3d3492-a018-4da8-b515-c975f0959650 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:48.995507 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-cc3d3492-a018-4da8-b515-c975f0959650 None None] For port 08f0c39e-0abc-4493-a5a4-9a5a01c8d173, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=08f0c39e-0abc-4493-a5a4-9a5a01c8d173,segment=NetworkSegment(f94ec7af-9f00-4e9b-a436-e9fef1d181e9),segment_id=f94ec7af-9f00-4e9b-a436-e9fef1d181e9)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:50:48.999925 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-cc3d3492-a018-4da8-b515-c975f0959650 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:49.049890 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc3d3492-a018-4da8-b515-c975f0959650 None None] Pushing event updated for resources: {'Port': ['ID=08f0c39e-0abc-4493-a5a4-9a5a01c8d173,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:50:49.221414 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-b52fd9a8-b5d2-41c0-81d3-97525b52bdae None None] Provisioning complete for port 08f0c39e-0abc-4493-a5a4-9a5a01c8d173 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:50:49.221710 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-b52fd9a8-b5d2-41c0-81d3-97525b52bdae None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:49.892857 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 08f0c39e-0abc-4493-a5a4-9a5a01c8d173 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:50:49.939300 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 08f0c39e-0abc-4493-a5a4-9a5a01c8d173 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:50:49.939930 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:50.285173 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 48966) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:50:50.602790 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [None req-c3374b26-687d-41a4-9c12-826a60eaf524 admin admin] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93835) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 16:50:50.603799 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-c3374b26-687d-41a4-9c12-826a60eaf524 admin admin] 10.222.0.67 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3176396 Sep 01 16:50:51.216701 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-ebdf31ba-ddd7-4354-96c7-94405d5dfd1f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:53.030223 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 48974) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:50:53.349549 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Request body: {'network': {'router:external': True, 'provider:network_type': 'flat', 'is_default': True, 'name': 'public', 'admin_state_up': True, 'provider:physical_network': 'physnet1'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:50:53.377409 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Made reservation on behalf of 06351ba5f71348f39c4fa270fc8aeb75 for: {'network': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:50:53.379689 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:53.389296 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:53.476314 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:53.480045 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:53.497869 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Reserving flat network on physical network physnet1 {{(pid=93836) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Sep 01 16:50:53.518954 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2de22717-6bfd-43d5-a83f-54e2c3073f5e,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:50:53.523835 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:53.524183 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.segments_db [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Added segment 74f97e23-9fdf-4c83-acaf-c3c8fafa1987 of type flat for network e28b8145-06a4-43a8-a9f2-9a7014f96a23 Sep 01 16:50:53.571387 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:53.603593 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:53.605092 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:50:53.605702 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:53.673954 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.6426010 Sep 01 16:50:53.684598 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c177820f-07c8-4fdb-a75c-1e51d9e7159e admin admin] Pushing event updated for resources: {'Network': ['ID=e28b8145-06a4-43a8-a9f2-9a7014f96a23,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:50:53.695349 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 16:50:53.772162 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:53.781879 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-9b99346f-ea17-47b3-bce6-2199c953def8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:54.830218 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:56.069272 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 48992) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:50:56.247264 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4931a0b0-c3c1-4879-b1c9-fa36e534fb4f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:50:56.248574 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-4931a0b0-c3c1-4879-b1c9-fa36e534fb4f admin admin] 10.222.0.67 "GET /v2.0/subnets/8342f334-c8a1-41cf-816c-e3f965162160 HTTP/1.1" status: 200 len: 849 time: 0.1782720 Sep 01 16:50:56.363591 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-f9f6a264-f82e-45f4-adb1-849c80c90dae admin admin] 10.222.0.67 "GET /v2.0/routers/24c6725c-780a-4e90-a2c9-10563cf12101 HTTP/1.1" status: 200 len: 704 time: 0.1089103 Sep 01 16:50:56.444920 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:56.627764 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:56.914671 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Allocated IP 172.20.0.1 (2fa7ae8c-5777-41e0-a6ca-6640bd1daec6/8342f334-c8a1-41cf-816c-e3f965162160/d2106e5f-0623-4ebf-b42f-7f82d5be4c06) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:50:57.108343 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:57.129256 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.provisioning_blocks [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Transition to ACTIVE for port object d2106e5f-0623-4ebf-b42f-7f82d5be4c06 will not be triggered until provisioned by entity DHCP. {{(pid=93836) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:50:57.196320 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:57.267050 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Network 2fa7ae8c-5777-41e0-a6ca-6640bd1daec6 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:50:57.271701 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:50:57.278344 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:50:57.279225 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1827972'] for router_interface, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:57.300283 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Pushing event updated for resources: {'Port': ['ID=d2106e5f-0623-4ebf-b42f-7f82d5be4c06,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:50:57.471857 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-f3d55f38-aa02-463f-a656-aef8506a3e29 None None] Provisioning for port d2106e5f-0623-4ebf-b42f-7f82d5be4c06 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:50:57.475421 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-f3d55f38-aa02-463f-a656-aef8506a3e29 None None] Provisioning complete for port d2106e5f-0623-4ebf-b42f-7f82d5be4c06 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:50:57.475802 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-f3d55f38-aa02-463f-a656-aef8506a3e29 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:57.476234 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:57.511973 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-f3d55f38-aa02-463f-a656-aef8506a3e29 None None] Port d2106e5f-0623-4ebf-b42f-7f82d5be4c06 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 16:50:57.680663 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Notify callbacks [] for port, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:57.685132 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:57.685899 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611336', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1832500'] for router_interface, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:57.761424 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Pushing event updated for resources: {'Port': ['ID=d2106e5f-0623-4ebf-b42f-7f82d5be4c06,revision_number=2']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:50:57.809941 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Network 2fa7ae8c-5777-41e0-a6ca-6640bd1daec6 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:50:57.811434 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:50:57.975972 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Router 24c6725c-780a-4e90-a2c9-10563cf12101 is scheduled to L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c with binding_index 1 {{(pid=93836) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 01 16:50:58.039264 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-c8b6521b-adbb-45a4-8b84-603a0d865c72 None None] Provisioning complete for port d2106e5f-0623-4ebf-b42f-7f82d5be4c06 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:50:58.039576 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-c8b6521b-adbb-45a4-8b84-603a0d865c72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:58.066458 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 16:50:58.074253 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-a2c7c625-40d4-44b3-b567-ebabd4568228 admin admin] 10.222.0.67 "PUT /v2.0/routers/24c6725c-780a-4e90-a2c9-10563cf12101/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.7045434 Sep 01 16:50:58.078434 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-c8b6521b-adbb-45a4-8b84-603a0d865c72 None None] Port d2106e5f-0623-4ebf-b42f-7f82d5be4c06 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 16:50:58.078936 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Sync routers for ids ['24c6725c-780a-4e90-a2c9-10563cf12101'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 16:50:58.093357 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Routers {'24c6725c-780a-4e90-a2c9-10563cf12101'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:50:58.094264 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:50:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['24c6725c-780a-4e90-a2c9-10563cf12101'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:50:58.299292 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Set router 24c6725c-780a-4e90-a2c9-10563cf12101 gateway port host: None {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:50:58.736765 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'name': 'router1', 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:50:47Z', 'updated_at': '2021-09-01T16:50:57Z', 'revision_number': 2, 'project_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'gw_port_host': None, '_interfaces': [{'id': 'd2106e5f-0623-4ebf-b42f-7f82d5be4c06', 'name': '', 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6', 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'mac_address': 'fa:16:3e:a6:90:e9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8342f334-c8a1-41cf-816c-e3f965162160', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:50:56Z', 'updated_at': '2021-09-01T16:50:57Z', 'revision_number': 2, 'project_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'subnets': [{'id': '8342f334-c8a1-41cf-816c-e3f965162160', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'f47e5704-c992-45b3-8b07-caa32197cfee'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:50:58.788842 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Checking router: 24c6725c-780a-4e90-a2c9-10563cf12101 for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 16:50:58.789212 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Updating router 24c6725c-780a-4e90-a2c9-10563cf12101 port d2106e5f-0623-4ebf-b42f-7f82d5be4c06 binding host dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 16:50:58.836153 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:59.354880 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Notify callbacks [] for port, precommit_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:59.374288 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.provisioning_blocks [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Transition to ACTIVE for port object d2106e5f-0623-4ebf-b42f-7f82d5be4c06 will not be triggered until provisioned by entity L2. {{(pid=93838) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:50:59.379575 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:59.524465 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Pushing event updated for resources: {'Port': ['ID=d2106e5f-0623-4ebf-b42f-7f82d5be4c06,revision_number=3']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:50:59.564960 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:59.565333 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:59.565793 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:59.566133 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:59.566471 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:59.566809 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:59.567140 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:59.567471 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:59.567819 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:59.568148 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:59.568475 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:59.568801 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Tracked resource versions report: Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: pushed versions: Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: { 'AddressGroup': {'1.2'}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'ConntrackHelper': {'1.0'}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Log': {'1.0'}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Network': {'1.1'}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Port': {'1.7'}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'PortForwarding': {'1.2'}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'QosPolicy': {'1.9'}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'SecurityGroup': {'1.4'}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'SecurityGroupRule': {'1.2'}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'SubPort': {'1.0'}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Subnet': {'1.1'}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Trunk': {'1.1'}} Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: consumer versions: Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: { DHCP agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: L3 agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: Metadata agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: Metering agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: Open vSwitch agent@dv-cinder-799668-16-iscsi: { 'AddressGroup': '1.2', Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'ConntrackHelper': '1.0', Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Log': '1.0', Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Network': '1.1', Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Port': '1.7', Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'PortForwarding': '1.2', Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'QosPolicy': '1.9', Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'SecurityGroup': '1.4', Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'SecurityGroupRule': '1.2', Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'SubPort': '1.0', Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Subnet': '1.1', Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Trunk': '1.1'}} Sep 01 16:50:59.570160 dv-cinder-799668-16-iscsi neutron-server[93838]: {{(pid=93838) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 01 16:50:59.581208 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Attempting to bind port d2106e5f-0623-4ebf-b42f-7f82d5be4c06 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:50:59.581634 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Attempting to bind port d2106e5f-0623-4ebf-b42f-7f82d5be4c06 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': 'f94ec7af-9f00-4e9b-a436-e9fef1d181e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6'}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:50:59.582073 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Attempting to bind port d2106e5f-0623-4ebf-b42f-7f82d5be4c06 on network 2fa7ae8c-5777-41e0-a6ca-6640bd1daec6 {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:50:59.591719 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 50, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:50:59.592141 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Checking segment: {'id': 'f94ec7af-9f00-4e9b-a436-e9fef1d181e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93838) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:50:59.592631 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:59.593032 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Bound using segment: {'id': 'f94ec7af-9f00-4e9b-a436-e9fef1d181e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6'} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:50:59.593570 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Bound port: d2106e5f-0623-4ebf-b42f-7f82d5be4c06, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f94ec7af-9f00-4e9b-a436-e9fef1d181e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6'}}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:50:59.593967 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:59.664059 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] For port d2106e5f-0623-4ebf-b42f-7f82d5be4c06, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93838) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:50:59.685523 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] For port d2106e5f-0623-4ebf-b42f-7f82d5be4c06, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=d2106e5f-0623-4ebf-b42f-7f82d5be4c06,segment=NetworkSegment(f94ec7af-9f00-4e9b-a436-e9fef1d181e9),segment_id=f94ec7af-9f00-4e9b-a436-e9fef1d181e9)] {{(pid=93838) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:50:59.690355 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:50:59.741631 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Routers {'24c6725c-780a-4e90-a2c9-10563cf12101'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:50:59.742271 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:50:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['24c6725c-780a-4e90-a2c9-10563cf12101'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:50:59.823053 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ab188c6-07af-43ae-9a7e-9a4a773dd20b None None] Pushing event updated for resources: {'Port': ['ID=d2106e5f-0623-4ebf-b42f-7f82d5be4c06,revision_number=4']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:50:59.852130 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] Set router 24c6725c-780a-4e90-a2c9-10563cf12101 gateway port host: None {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:51:00.075594 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'name': 'router1', 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:50:47Z', 'updated_at': '2021-09-01T16:50:57Z', 'revision_number': 2, 'project_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'gw_port_host': None, '_interfaces': [{'id': 'd2106e5f-0623-4ebf-b42f-7f82d5be4c06', 'name': '', 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6', 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'mac_address': 'fa:16:3e:a6:90:e9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8342f334-c8a1-41cf-816c-e3f965162160', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:50:56Z', 'updated_at': '2021-09-01T16:50:59Z', 'revision_number': 4, 'project_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'subnets': [{'id': '8342f334-c8a1-41cf-816c-e3f965162160', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'f47e5704-c992-45b3-8b07-caa32197cfee'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:51:00.102064 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bafb639f-2808-4301-96d8-5ac8cfc7b5cb None None] The sync data for ids ['24c6725c-780a-4e90-a2c9-10563cf12101'] in dv-cinder-799668-16-iscsi is: [{'id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'name': 'router1', 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:50:47Z', 'updated_at': '2021-09-01T16:50:57Z', 'revision_number': 2, 'project_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'gw_port_host': None, '_interfaces': [{'id': 'd2106e5f-0623-4ebf-b42f-7f82d5be4c06', 'name': '', 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6', 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'mac_address': 'fa:16:3e:a6:90:e9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8342f334-c8a1-41cf-816c-e3f965162160', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:50:56Z', 'updated_at': '2021-09-01T16:50:59Z', 'revision_number': 4, 'project_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'subnets': [{'id': '8342f334-c8a1-41cf-816c-e3f965162160', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'f47e5704-c992-45b3-8b07-caa32197cfee'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 16:51:00.320668 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49014) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:51:00.435331 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e41f512-d606-487c-9b33-d54e83a8523e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:51:00.436589 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-4e41f512-d606-487c-9b33-d54e83a8523e admin admin] 10.222.0.67 "GET /v2.0/networks/e28b8145-06a4-43a8-a9f2-9a7014f96a23 HTTP/1.1" status: 200 len: 842 time: 0.1149528 Sep 01 16:51:00.446782 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-2d3c9b49-df63-4c98-9152-1c9b952f9357 admin admin] Request body: {'subnet': {'cidr': '172.27.1.0/24', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'gateway_ip': '172.27.1.1', 'name': 'public-subnet', 'ip_version': 4, 'enable_dhcp': False}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:51:00.466732 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2d3c9b49-df63-4c98-9152-1c9b952f9357 admin admin] Made reservation on behalf of 06351ba5f71348f39c4fa270fc8aeb75 for: {'subnet': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:51:00.469180 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2d3c9b49-df63-4c98-9152-1c9b952f9357 admin admin] Notify callbacks [] for subnet, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:00.819971 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.objects.ports [None req-2d3c9b49-df63-4c98-9152-1c9b952f9357 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=93836) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Sep 01 16:51:00.820341 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2d3c9b49-df63-4c98-9152-1c9b952f9357 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for subnet, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:00.873460 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d3c9b49-df63-4c98-9152-1c9b952f9357 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bb03a81f-6f53-44d6-90e9-69e9ac09604e,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:51:00.881780 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d3c9b49-df63-4c98-9152-1c9b952f9357 admin admin] Checking segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93836) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:51:00.882135 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d3c9b49-df63-4c98-9152-1c9b952f9357 admin admin] Network hostable DHCP agents. Network: e28b8145-06a4-43a8-a9f2-9a7014f96a23, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93836) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 16:51:00.899092 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d3c9b49-df63-4c98-9152-1c9b952f9357 admin admin] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93836) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 16:51:00.908099 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-2d3c9b49-df63-4c98-9152-1c9b952f9357 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, e28b8145-06a4-43a8-a9f2-9a7014f96a23) {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:51:00.912424 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d3c9b49-df63-4c98-9152-1c9b952f9357 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:51:00.913020 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2d3c9b49-df63-4c98-9152-1c9b952f9357 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:00.917889 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ddd3cbe-6043-4c58-8f5e-8fd163d797b0 None None] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:51:00.926896 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-2d3c9b49-df63-4c98-9152-1c9b952f9357 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4835644 Sep 01 16:51:01.060276 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9373b69f-86a9-4453-8ba8-90830a2ba719 None None] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:51:03.290681 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49022) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:51:03.420889 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-1b1e074d-6375-4ca8-bbb2-f2a20df72d8e admin admin] 10.222.0.67 "GET /v2.0/routers/24c6725c-780a-4e90-a2c9-10563cf12101 HTTP/1.1" status: 200 len: 710 time: 0.1285861 Sep 01 16:51:03.508354 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6ec3326-a8cd-4c99-a6c2-e9d34663b444 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:51:03.509754 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-a6ec3326-a8cd-4c99-a6c2-e9d34663b444 admin admin] 10.222.0.67 "GET /v2.0/networks/e28b8145-06a4-43a8-a9f2-9a7014f96a23 HTTP/1.1" status: 200 len: 886 time: 0.0833769 Sep 01 16:51:03.519702 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:51:03.775152 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:04.007304 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:04.083279 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:04.184399 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Allocated IP 172.27.1.122 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/7fd45d38-d151-4034-b77f-bcc73d2c1fe7) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:51:04.281970 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:04.320029 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:04.362231 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:51:04.365004 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:51:04.368513 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:51:04.403900 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Pushing event updated for resources: {'Port': ['ID=7fd45d38-d151-4034-b77f-bcc73d2c1fe7,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:51:04.548306 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 5 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:51:04.712735 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:04.908493 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1833194', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1833948', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-4850'] for router, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:04.911928 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1833207', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1833185', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1833208', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1833925'] for router, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:05.019186 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Router 24c6725c-780a-4e90-a2c9-10563cf12101 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 16:51:05.124291 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 16:51:05.128398 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] Notify callbacks [] for router, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:05.129618 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-261e9697-e959-4b75-9b19-b81d078e21cd admin admin] 10.222.0.67 "PUT /v2.0/routers/24c6725c-780a-4e90-a2c9-10563cf12101 HTTP/1.1" status: 200 len: 890 time: 1.6132097 Sep 01 16:51:05.918441 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device d2106e5f-0623-4ebf-b42f-7f82d5be4c06 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:51:05.968070 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port d2106e5f-0623-4ebf-b42f-7f82d5be4c06 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:51:05.971865 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port d2106e5f-0623-4ebf-b42f-7f82d5be4c06 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:51:05.972241 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:06.051732 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:06.084052 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port d2106e5f-0623-4ebf-b42f-7f82d5be4c06, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=d2106e5f-0623-4ebf-b42f-7f82d5be4c06,segment=NetworkSegment(f94ec7af-9f00-4e9b-a436-e9fef1d181e9),segment_id=f94ec7af-9f00-4e9b-a436-e9fef1d181e9)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:51:06.088093 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:06.185731 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=d2106e5f-0623-4ebf-b42f-7f82d5be4c06,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:51:06.539790 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Sync routers for ids ['24c6725c-780a-4e90-a2c9-10563cf12101'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 16:51:06.550720 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Routers {'24c6725c-780a-4e90-a2c9-10563cf12101'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:51:06.551354 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:50:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['24c6725c-780a-4e90-a2c9-10563cf12101'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:51:06.759064 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Set router 24c6725c-780a-4e90-a2c9-10563cf12101 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:51:07.158519 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'name': 'router1', 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.122'}], 'enable_snat': True}, 'gw_port_id': '7fd45d38-d151-4034-b77f-bcc73d2c1fe7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:50:47Z', 'updated_at': '2021-09-01T16:51:04Z', 'revision_number': 4, 'project_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'gw_port': {'id': '7fd45d38-d151-4034-b77f-bcc73d2c1fe7', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:de:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:51:04Z', 'updated_at': '2021-09-01T16:51:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'd2106e5f-0623-4ebf-b42f-7f82d5be4c06', 'name': '', 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6', 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'mac_address': 'fa:16:3e:a6:90:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8342f334-c8a1-41cf-816c-e3f965162160', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:50:56Z', 'updated_at': '2021-09-01T16:51:06Z', 'revision_number': 5, 'project_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'subnets': [{'id': '8342f334-c8a1-41cf-816c-e3f965162160', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'f47e5704-c992-45b3-8b07-caa32197cfee'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:51:07.208571 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Checking router: 24c6725c-780a-4e90-a2c9-10563cf12101 for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 16:51:07.208928 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Updating router 24c6725c-780a-4e90-a2c9-10563cf12101 port 7fd45d38-d151-4034-b77f-bcc73d2c1fe7 binding host dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 16:51:07.257855 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:07.569498 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49034) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:51:07.573094 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Notify callbacks [] for port, precommit_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:07.583107 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Transition to ACTIVE for port object 7fd45d38-d151-4034-b77f-bcc73d2c1fe7 will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:51:07.589359 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:07.636443 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Attempting to bind port 7fd45d38-d151-4034-b77f-bcc73d2c1fe7 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:51:07.636882 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Attempting to bind port 7fd45d38-d151-4034-b77f-bcc73d2c1fe7 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:51:07.637319 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Attempting to bind port 7fd45d38-d151-4034-b77f-bcc73d2c1fe7 on network e28b8145-06a4-43a8-a9f2-9a7014f96a23 {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:51:07.645832 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08881e90-4bc3-4b96-8a91-5350a12e36ee None None] Pushing event updated for resources: {'Port': ['ID=7fd45d38-d151-4034-b77f-bcc73d2c1fe7,revision_number=2']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:51:07.648259 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 50, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:51:07.648637 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Checking segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:51:07.649037 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:07.649451 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Bound using segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:51:07.649928 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Bound port: 7fd45d38-d151-4034-b77f-bcc73d2c1fe7, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:51:07.650579 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:07.686881 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-491f984a-9494-4d9f-b1cd-ddc61204f693 admin admin] 10.222.0.67 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1162603 Sep 01 16:51:07.706538 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] For port 7fd45d38-d151-4034-b77f-bcc73d2c1fe7, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:51:07.710122 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] For port 7fd45d38-d151-4034-b77f-bcc73d2c1fe7, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=7fd45d38-d151-4034-b77f-bcc73d2c1fe7,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:51:07.715197 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:07.776598 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08881e90-4bc3-4b96-8a91-5350a12e36ee None None] Pushing event updated for resources: {'Port': ['ID=7fd45d38-d151-4034-b77f-bcc73d2c1fe7,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:51:07.779170 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Routers {'24c6725c-780a-4e90-a2c9-10563cf12101'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:51:07.779779 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:50:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['24c6725c-780a-4e90-a2c9-10563cf12101'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:51:07.949008 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device d2106e5f-0623-4ebf-b42f-7f82d5be4c06 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:51:08.005333 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] Set router 24c6725c-780a-4e90-a2c9-10563cf12101 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:51:08.055207 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port d2106e5f-0623-4ebf-b42f-7f82d5be4c06 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:51:08.055591 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:08.289558 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'name': 'router1', 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.122'}], 'enable_snat': True}, 'gw_port_id': '7fd45d38-d151-4034-b77f-bcc73d2c1fe7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:50:47Z', 'updated_at': '2021-09-01T16:51:04Z', 'revision_number': 4, 'project_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'gw_port': {'id': '7fd45d38-d151-4034-b77f-bcc73d2c1fe7', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:de:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:51:04Z', 'updated_at': '2021-09-01T16:51:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'd2106e5f-0623-4ebf-b42f-7f82d5be4c06', 'name': '', 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6', 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'mac_address': 'fa:16:3e:a6:90:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8342f334-c8a1-41cf-816c-e3f965162160', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:50:56Z', 'updated_at': '2021-09-01T16:51:06Z', 'revision_number': 5, 'project_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'subnets': [{'id': '8342f334-c8a1-41cf-816c-e3f965162160', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'f47e5704-c992-45b3-8b07-caa32197cfee'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:51:08.320551 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf894dde-21e2-4022-ac07-658abed80f01 None None] The sync data for ids ['24c6725c-780a-4e90-a2c9-10563cf12101'] in dv-cinder-799668-16-iscsi is: [{'id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'name': 'router1', 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.122'}], 'enable_snat': True}, 'gw_port_id': '7fd45d38-d151-4034-b77f-bcc73d2c1fe7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:50:47Z', 'updated_at': '2021-09-01T16:51:04Z', 'revision_number': 4, 'project_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'gw_port': {'id': '7fd45d38-d151-4034-b77f-bcc73d2c1fe7', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:de:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:51:04Z', 'updated_at': '2021-09-01T16:51:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'd2106e5f-0623-4ebf-b42f-7f82d5be4c06', 'name': '', 'network_id': '2fa7ae8c-5777-41e0-a6ca-6640bd1daec6', 'tenant_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'mac_address': 'fa:16:3e:a6:90:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24c6725c-780a-4e90-a2c9-10563cf12101', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8342f334-c8a1-41cf-816c-e3f965162160', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:50:56Z', 'updated_at': '2021-09-01T16:51:06Z', 'revision_number': 5, 'project_id': '7bf15fe9f7d34f029054dbc18d5c4c7a', 'subnets': [{'id': '8342f334-c8a1-41cf-816c-e3f965162160', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'f47e5704-c992-45b3-8b07-caa32197cfee'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 16:51:09.962114 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 7fd45d38-d151-4034-b77f-bcc73d2c1fe7 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:51:10.020220 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 7fd45d38-d151-4034-b77f-bcc73d2c1fe7 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:51:10.024066 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 7fd45d38-d151-4034-b77f-bcc73d2c1fe7 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:51:10.024611 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:10.111596 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:10.132175 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port 7fd45d38-d151-4034-b77f-bcc73d2c1fe7, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=7fd45d38-d151-4034-b77f-bcc73d2c1fe7,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:51:10.137983 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:10.193279 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=7fd45d38-d151-4034-b77f-bcc73d2c1fe7,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:51:11.947169 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 7fd45d38-d151-4034-b77f-bcc73d2c1fe7 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:51:12.020213 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 7fd45d38-d151-4034-b77f-bcc73d2c1fe7 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:51:12.020870 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:21.223341 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-d12f564a-588d-45e2-8279-9bb80ade5fd7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:23.724279 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:23.766769 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-b5352859-8f86-4c62-b1b5-b88c6c26099b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:24.838741 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:26.469530 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:41.547350 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 5 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:51:51.220376 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-da2e6fdb-7851-4839-a239-fc5a581121d0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:53.736422 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:53.760194 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-cd1ccf74-8519-4d49-9942-ed4dfe23efa8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:54.841518 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:51:56.473638 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:18.546171 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 5 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:52:21.214021 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-442c33cc-a859-4756-b3ac-a0570368e960 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:23.729243 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:23.763676 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-af5405c5-fe03-4e07-b49f-2418213494d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:24.839107 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:26.473291 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:43.681503 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49596) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:52:43.741290 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.pecan_wsgi.hooks.translation [None req-a6dc2fa2-940a-4e38-9f7f-68861190589d admin admin] GET failed (client error): The resource could not be found. Sep 01 16:52:43.743338 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-a6dc2fa2-940a-4e38-9f7f-68861190589d admin admin] 10.222.0.67 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0608821 Sep 01 16:52:43.900948 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45e2199d-9cee-475b-8605-1bee710ae52f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:52:43.902460 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-45e2199d-9cee-475b-8605-1bee710ae52f admin admin] 10.222.0.67 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1544411 Sep 01 16:52:46.088627 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49606) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:52:46.179947 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b9ba006-0f93-46d0-bb4a-7e6f2b1cd10d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:52:46.181214 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-0b9ba006-0f93-46d0-bb4a-7e6f2b1cd10d admin admin] 10.222.0.67 "GET /v2.0/subnets/8342f334-c8a1-41cf-816c-e3f965162160 HTTP/1.1" status: 200 len: 849 time: 0.0916255 Sep 01 16:52:46.191227 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:52:46.277218 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Notify callbacks [] for subnet, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:46.414913 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8748409257692'] for subnet, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:46.447517 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:52:46.448024 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:46.449314 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] 10.222.0.67 "PUT /v2.0/subnets/8342f334-c8a1-41cf-816c-e3f965162160 HTTP/1.1" status: 200 len: 868 time: 0.2617404 Sep 01 16:52:46.468357 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d23f1d69-611f-4e29-a577-23d77519dfe1 None None] Network 2fa7ae8c-5777-41e0-a6ca-6640bd1daec6 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:52:46.471338 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8342f334-c8a1-41cf-816c-e3f965162160,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:52:46.478934 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:52:46.479315 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:52:46.479665 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:52:46.480009 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:52:46.480348 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:52:46.480700 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:52:46.481039 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:52:46.481428 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:52:46.481774 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:52:46.482113 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:52:46.482494 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:52:46.482823 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be9cff54-ce48-4084-a91c-28ee512f0f23 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:52:46.885289 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-76156993-3fae-4803-b821-bb73a4612902 None None] Provisioning complete for port d2106e5f-0623-4ebf-b42f-7f82d5be4c06 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:52:46.885755 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-76156993-3fae-4803-b821-bb73a4612902 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:46.984969 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-76156993-3fae-4803-b821-bb73a4612902 None None] Provisioning complete for port 08f0c39e-0abc-4493-a5a4-9a5a01c8d173 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:52:46.985331 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-76156993-3fae-4803-b821-bb73a4612902 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:48.700856 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49614) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:52:48.902124 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e476d55-ce23-451e-bfc3-c11a7d7077f0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:52:48.902529 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e476d55-ce23-451e-bfc3-c11a7d7077f0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:52:48.904075 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-8e476d55-ce23-451e-bfc3-c11a7d7077f0 admin admin] 10.222.0.67 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2022264 Sep 01 16:52:51.166143 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49622) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:52:51.221508 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-deb1a9e1-8f34-40bc-8b04-4c2d91e5a688 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:51.308426 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57246c04-4f15-4bbc-b947-4c981ec7bb10 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:52:51.308824 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57246c04-4f15-4bbc-b947-4c981ec7bb10 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:52:51.310405 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-57246c04-4f15-4bbc-b947-4c981ec7bb10 admin admin] 10.222.0.67 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1433024 Sep 01 16:52:53.563296 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49630) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:52:53.691727 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bad1b5d6-95e5-44fb-9369-b0368adcd42c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:52:53.693108 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-bad1b5d6-95e5-44fb-9369-b0368adcd42c admin admin] 10.222.0.67 "GET /v2.0/networks/2fa7ae8c-5777-41e0-a6ca-6640bd1daec6 HTTP/1.1" status: 200 len: 869 time: 0.1287999 Sep 01 16:52:53.734180 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:53.766746 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-1878b223-c029-4a18-9899-556367f71c75 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:54.844114 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:55.544553 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 5 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:52:55.981534 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49638) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:52:56.215518 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe4ed4a2-ab93-480b-80b3-97eb10d27c7a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:52:56.216831 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-fe4ed4a2-ab93-480b-80b3-97eb10d27c7a admin admin] 10.222.0.67 "GET /v2.0/networks/e28b8145-06a4-43a8-a9f2-9a7014f96a23 HTTP/1.1" status: 200 len: 886 time: 0.2343328 Sep 01 16:52:56.478617 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:52:58.384939 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49646) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:52:58.505130 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0eea5db8-759f-4dc6-b32d-2f26a14c001d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:52:58.505622 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0eea5db8-759f-4dc6-b32d-2f26a14c001d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:52:58.507217 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-0eea5db8-759f-4dc6-b32d-2f26a14c001d admin admin] 10.222.0.67 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1212659 Sep 01 16:53:00.695575 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49654) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:53:00.789377 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c475f392-0bcb-45d9-9e1b-4f4f2c7dfebd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:53:00.789867 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c475f392-0bcb-45d9-9e1b-4f4f2c7dfebd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:53:00.791386 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c475f392-0bcb-45d9-9e1b-4f4f2c7dfebd admin admin] 10.222.0.67 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0948634 Sep 01 16:53:02.999102 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49662) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:53:03.090474 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f14afa2-de99-4cb2-b024-a9b1380c7321 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:53:03.091840 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-9f14afa2-de99-4cb2-b024-a9b1380c7321 admin admin] 10.222.0.67 "GET /v2.0/subnets/8342f334-c8a1-41cf-816c-e3f965162160 HTTP/1.1" status: 200 len: 868 time: 0.0918009 Sep 01 16:53:05.359148 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49670) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:53:05.450676 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddbda091-4397-4550-ba56-358dc4924e2c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:53:05.452018 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-ddbda091-4397-4550-ba56-358dc4924e2c admin admin] 10.222.0.67 "GET /v2.0/subnets/bb03a81f-6f53-44d6-90e9-69e9ac09604e HTTP/1.1" status: 200 len: 816 time: 0.0919235 Sep 01 16:53:21.219135 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-2d9d5591-5a1d-4854-963f-614d4353a36f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:23.735830 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:23.766473 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-0fcebea1-6932-42b8-a6b9-013fa57ebeb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:24.846130 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:26.483998 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:29.448177 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49724) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:53:29.495485 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [None req-5abeb6cd-b610-4c2b-be8e-9cf502700b84 admin admin] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93836) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 16:53:29.496502 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-5abeb6cd-b610-4c2b-be8e-9cf502700b84 admin admin] 10.222.0.67 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0473723 Sep 01 16:53:31.769094 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49732) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:53:31.832592 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.pecan_wsgi.hooks.translation [None req-dcbc93cb-8573-4a5d-8c79-b6ec4ccb5f40 admin admin] GET failed (client error): The resource could not be found. Sep 01 16:53:31.834568 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-dcbc93cb-8573-4a5d-8c79-b6ec4ccb5f40 admin admin] 10.222.0.67 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0645032 Sep 01 16:53:31.920500 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0a380a6-e10d-42bd-b9df-20685b8e244a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:53:31.922012 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-a0a380a6-e10d-42bd-b9df-20685b8e244a admin admin] 10.222.0.67 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.0828810 Sep 01 16:53:32.543088 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 5 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:53:34.152551 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 49740) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:53:34.204866 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Request body: {'network': {'admin_state_up': True, 'shared': True, 'name': 'shared'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:53:34.206640 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.quota [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Loaded quota_driver: . Sep 01 16:53:34.261615 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Made reservation on behalf of 06351ba5f71348f39c4fa270fc8aeb75 for: {'network': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:53:34.327772 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.policy [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=93835) register_rules /opt/stack/neutron/neutron/policy.py:73}} Sep 01 16:53:34.372735 dv-cinder-799668-16-iscsi neutron-server[93835]: WARNING oslo_policy.policy [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 01 16:53:34.373118 dv-cinder-799668-16-iscsi neutron-server[93835]: WARNING oslo_policy.policy [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 01 16:53:34.384398 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:34.443217 dv-cinder-799668-16-iscsi neutron-server[93835]: WARNING neutron.services.revisions.revision_plugin [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Could not find related network for resource to bump revision. Sep 01 16:53:34.464170 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] vlan segment allocate from pool success with {'vlan_id': 533, 'physical_network': 'physnet1'} {{(pid=93835) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 16:53:34.479364 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8748409195722', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:34.480113 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Unsubscribe: segment precommit_create {{(pid=93835) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Sep 01 16:53:34.480389 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.segments_db [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Added segment 158e4a10-7bf0-4070-aeaf-6bca65a0cfb8 of type vlan for network e9938d8d-ca3e-435d-b9ce-6643cd80643e Sep 01 16:53:34.559762 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:34.596630 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:34.597866 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:53:34.598590 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:34.625289 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4716690 Sep 01 16:53:34.712387 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Pushing event updated for resources: {'Network': ['ID=e9938d8d-ca3e-435d-b9ce-6643cd80643e,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:53:34.721931 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:34.722197 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:34.722545 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:34.722884 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:34.723230 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:34.723572 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:34.724542 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:34.725039 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:34.725450 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:34.725754 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:34.726086 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:34.726417 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4137d481-2faf-4881-881c-2e75d1395f80 admin admin] Tracked resource versions report: Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: pushed versions: Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: { 'AddressGroup': {'1.2'}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'ConntrackHelper': {'1.0'}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Log': {'1.0'}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Network': {'1.1'}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Port': {'1.7'}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'PortForwarding': {'1.2'}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'QosPolicy': {'1.9'}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'SecurityGroup': {'1.4'}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'SecurityGroupRule': {'1.2'}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'SubPort': {'1.0'}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Subnet': {'1.1'}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Trunk': {'1.1'}} Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: consumer versions: Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: { DHCP agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: L3 agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: Metadata agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: Metering agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: Open vSwitch agent@dv-cinder-799668-16-iscsi: { 'AddressGroup': '1.2', Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'ConntrackHelper': '1.0', Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Log': '1.0', Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Network': '1.1', Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Port': '1.7', Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'PortForwarding': '1.2', Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'QosPolicy': '1.9', Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'SecurityGroup': '1.4', Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'SecurityGroupRule': '1.2', Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'SubPort': '1.0', Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Subnet': '1.1', Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Trunk': '1.1'}} Sep 01 16:53:34.727804 dv-cinder-799668-16-iscsi neutron-server[93835]: {{(pid=93835) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 01 16:53:34.766392 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network e9938d8d-ca3e-435d-b9ce-6643cd80643e details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 16:53:36.942402 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 49756) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:53:37.008701 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.pecan_wsgi.hooks.translation [None req-acfda96e-d9d9-48ae-a7f6-cf0d6de1a3ea admin admin] GET failed (client error): The resource could not be found. Sep 01 16:53:37.010061 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-acfda96e-d9d9-48ae-a7f6-cf0d6de1a3ea admin admin] 10.222.0.67 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0666096 Sep 01 16:53:37.111741 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b72d7ca-e248-4050-9307-4f182d0e5d2b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:53:37.113195 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-4b72d7ca-e248-4050-9307-4f182d0e5d2b admin admin] 10.222.0.67 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0985751 Sep 01 16:53:37.124343 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-9cac2161-0405-479c-90cd-fc6bc533c72b admin admin] Request body: {'subnet': {'name': 'shared-subnet', 'description': 'shared-subnet', 'cidr': '192.168.233.0/24', 'network_id': 'e9938d8d-ca3e-435d-b9ce-6643cd80643e', 'ip_version': 4}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:53:37.147563 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9cac2161-0405-479c-90cd-fc6bc533c72b admin admin] Made reservation on behalf of 06351ba5f71348f39c4fa270fc8aeb75 for: {'subnet': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:53:37.149808 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9cac2161-0405-479c-90cd-fc6bc533c72b admin admin] Notify callbacks [] for subnet, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:37.396063 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9cac2161-0405-479c-90cd-fc6bc533c72b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for subnet, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:37.477802 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cac2161-0405-479c-90cd-fc6bc533c72b admin admin] Pushing event updated for resources: {'Subnet': ['ID=1e312bda-993b-4495-b01a-9110a964ebd6,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:53:37.482263 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cac2161-0405-479c-90cd-fc6bc533c72b admin admin] Checking segment: {'id': '158e4a10-7bf0-4070-aeaf-6bca65a0cfb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 533, 'network_id': 'e9938d8d-ca3e-435d-b9ce-6643cd80643e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:53:37.482653 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cac2161-0405-479c-90cd-fc6bc533c72b admin admin] Network hostable DHCP agents. Network: e9938d8d-ca3e-435d-b9ce-6643cd80643e, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93835) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 16:53:37.502477 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cac2161-0405-479c-90cd-fc6bc533c72b admin admin] Network e9938d8d-ca3e-435d-b9ce-6643cd80643e is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93835) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 16:53:37.513313 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-9cac2161-0405-479c-90cd-fc6bc533c72b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, e9938d8d-ca3e-435d-b9ce-6643cd80643e) {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:53:37.518061 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9cac2161-0405-479c-90cd-fc6bc533c72b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:53:37.518659 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9cac2161-0405-479c-90cd-fc6bc533c72b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:37.523756 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b264b06-e8c3-4eae-834e-37164aad4b9c None None] Network e9938d8d-ca3e-435d-b9ce-6643cd80643e requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:53:37.532838 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-9cac2161-0405-479c-90cd-fc6bc533c72b admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.4119940 Sep 01 16:53:37.781346 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ce91fdb-f9d4-529e-8715-29775a2007ca-e9938d8d-ca3e-435d-b9ce-6643cd80643e', 'network_id': 'e9938d8d-ca3e-435d-b9ce-6643cd80643e', 'tenant_id': '06351ba5f71348f39c4fa270fc8aeb75', 'fixed_ips': [{'subnet_id': '1e312bda-993b-4495-b01a-9110a964ebd6'}]}} from dv-cinder-799668-16-iscsi. {{(pid=93837) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 01 16:53:37.782240 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:37.919999 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.db_base_plugin_common [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Allocated IP 192.168.233.2 (e9938d8d-ca3e-435d-b9ce-6643cd80643e/1e312bda-993b-4495-b01a-9110a964ebd6/257dff31-bfa3-48c2-9395-2e392ae2c709) {{(pid=93837) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:53:38.064636 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Notify callbacks [] for port, precommit_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:38.075048 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Transition to ACTIVE for port object 257dff31-bfa3-48c2-9395-2e392ae2c709 will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:53:38.091711 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Transition to ACTIVE for port object 257dff31-bfa3-48c2-9395-2e392ae2c709 will not be triggered until provisioned by entity DHCP. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:53:38.097841 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:38.137370 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Network e9938d8d-ca3e-435d-b9ce-6643cd80643e is already hosted by enough agents. {{(pid=93837) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:53:38.142092 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.base_scheduler [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Resources bound (agent type, host, resource id): {{(pid=93837) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:53:38.145606 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Received port after_create {{(pid=93837) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:53:38.154440 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Pushing event updated for resources: {'Port': ['ID=257dff31-bfa3-48c2-9395-2e392ae2c709,revision_number=1']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:53:38.177184 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:38.177719 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:38.178113 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:38.178456 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:38.178809 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:38.179147 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:38.179480 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:38.179809 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:38.180150 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:38.180476 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:38.180801 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:38.181123 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:53:38.215443 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Attempting to bind port 257dff31-bfa3-48c2-9395-2e392ae2c709 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:53:38.215823 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Attempting to bind port 257dff31-bfa3-48c2-9395-2e392ae2c709 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '158e4a10-7bf0-4070-aeaf-6bca65a0cfb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 533, 'network_id': 'e9938d8d-ca3e-435d-b9ce-6643cd80643e'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:53:38.216177 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Attempting to bind port 257dff31-bfa3-48c2-9395-2e392ae2c709 on network e9938d8d-ca3e-435d-b9ce-6643cd80643e {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:53:38.221170 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 53, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:53:38.221571 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Checking segment: {'id': '158e4a10-7bf0-4070-aeaf-6bca65a0cfb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 533, 'network_id': 'e9938d8d-ca3e-435d-b9ce-6643cd80643e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:53:38.221964 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:38.222349 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Bound using segment: {'id': '158e4a10-7bf0-4070-aeaf-6bca65a0cfb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 533, 'network_id': 'e9938d8d-ca3e-435d-b9ce-6643cd80643e'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:53:38.222803 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Bound port: 257dff31-bfa3-48c2-9395-2e392ae2c709, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '158e4a10-7bf0-4070-aeaf-6bca65a0cfb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 533, 'network_id': 'e9938d8d-ca3e-435d-b9ce-6643cd80643e'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:53:38.223196 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:38.284987 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] For port 257dff31-bfa3-48c2-9395-2e392ae2c709, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:53:38.288184 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] For port 257dff31-bfa3-48c2-9395-2e392ae2c709, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=257dff31-bfa3-48c2-9395-2e392ae2c709,segment=NetworkSegment(158e4a10-7bf0-4070-aeaf-6bca65a0cfb8),segment_id=158e4a10-7bf0-4070-aeaf-6bca65a0cfb8)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:53:38.294250 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:38.356024 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bfb7179-5e7a-48ef-aaaa-e55d172409cf None None] Pushing event updated for resources: {'Port': ['ID=257dff31-bfa3-48c2-9395-2e392ae2c709,revision_number=2']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:53:39.185184 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a169be4-6f96-4357-b1b6-2baf5322c6ab None None] Network e9938d8d-ca3e-435d-b9ce-6643cd80643e requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:53:39.239901 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-a2ed597e-e3f8-4260-b1b6-bd774f16e372 None None] Provisioning for port 257dff31-bfa3-48c2-9395-2e392ae2c709 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:53:40.037147 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 257dff31-bfa3-48c2-9395-2e392ae2c709 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:53:40.087750 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 257dff31-bfa3-48c2-9395-2e392ae2c709 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:53:40.091675 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 257dff31-bfa3-48c2-9395-2e392ae2c709 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:53:40.092045 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:40.169126 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:40.202730 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port 257dff31-bfa3-48c2-9395-2e392ae2c709, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=257dff31-bfa3-48c2-9395-2e392ae2c709,segment=NetworkSegment(158e4a10-7bf0-4070-aeaf-6bca65a0cfb8),segment_id=158e4a10-7bf0-4070-aeaf-6bca65a0cfb8)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:53:40.206723 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:40.258413 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=257dff31-bfa3-48c2-9395-2e392ae2c709,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:53:42.018276 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 257dff31-bfa3-48c2-9395-2e392ae2c709 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:53:42.067224 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 257dff31-bfa3-48c2-9395-2e392ae2c709 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:53:42.068117 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:51.219733 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-231d30cc-845a-442b-913a-9b4b7ae4c67e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:53.737479 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:53.766226 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-087d3ff8-97df-4cb1-a2f6-171f9e1c18d5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:54.850130 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:53:56.486186 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:09.542247 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 5 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:54:21.220418 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-a9225e12-5e70-49dc-b90d-7e3a977c427a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:23.739851 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:23.766025 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-70d5c7ab-9f6d-4a64-a679-f0f79fc4ec7d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:24.852331 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:26.486820 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:46.344924 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 49808) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:54:46.351889 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [None req-1726e2eb-f6e5-40d1-b2bc-0e086bae5b52 tempest-verify_tempest_config-1212452038 tempest-verify_tempest_config-1212452038-project] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93835) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 16:54:46.352869 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-1726e2eb-f6e5-40d1-b2bc-0e086bae5b52 tempest-verify_tempest_config-1212452038 tempest-verify_tempest_config-1212452038-project] 10.222.0.67 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13635 time: 0.0069463 Sep 01 16:54:46.541662 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 5 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:54:46.685021 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49826) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:54:46.798935 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:46.916568 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:46.920658 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:46.972242 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=85604b336f47409795e0214aa483b397&name=default HTTP/1.1" status: 200 len: 2975 time: 0.2859528 Sep 01 16:54:46.973262 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e634f014-5c3e-41ec-be4d-76a5133c414a,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:54:46.974963 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 49832) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:54:46.980196 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:46.980554 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:46.980911 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:46.981248 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:46.981612 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:46.981959 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:46.982295 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:46.982642 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:46.983004 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:46.983325 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:46.983650 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:46.983973 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-85fc2d67-7204-4a5e-ac68-e7c5665c324a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:47.056749 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:47.081696 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:47.179464 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:47.181990 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:47.183238 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/e634f014-5c3e-41ec-be4d-76a5133c414a HTTP/1.1" status: 204 len: 168 time: 0.2071898 Sep 01 16:54:47.193165 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e634f014-5c3e-41ec-be4d-76a5133c414a,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:54:47.202127 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:47.202551 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:47.202817 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:47.203152 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:47.203484 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:47.203893 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:47.204161 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:47.204504 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:47.204853 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:47.205173 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:47.206702 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:47.207643 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d609d2d-34e0-4b6f-b3af-24131ac08cd1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:54:51.223398 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-0bfeb5e0-0f4e-4298-b532-d6bd8a432600 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:53.741071 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:53.765622 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-4371e3d5-baa6-435d-a047-a1f2dbb26530 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:54.856414 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:54:56.490764 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:55:21.223739 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-032efab6-b516-4917-9397-3da4ee49f25b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:55:23.539751 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 5 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:55:23.742629 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:55:23.765748 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-8d913ed2-f5cb-465e-97dd-f8310e09c7fe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:55:24.857619 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:55:26.493303 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:55:51.224516 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-3cc676c9-9424-4e58-a1a8-bb6c00c13c5e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:55:53.744946 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:55:53.765072 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-a564131b-efd5-4d80-b93a-e831629da3b1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:55:54.860685 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:55:56.495853 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:56:00.538797 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 5 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:56:21.225424 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-77b92b51-6528-4a9d-9a54-617707cced66 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:56:23.747333 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:56:23.767011 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-826c6283-6484-45b8-bce8-bb604df55387 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:56:24.863944 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:56:26.416857 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1832696'] for agent, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:56:26.498436 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:56:37.537286 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:56:41.059273 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49904) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:56:41.163833 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-a4adf9f5-12d6-42dd-8766-6a027ad233c7 admin admin] 10.222.0.67 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4309 time: 0.1034718 Sep 01 16:56:43.350252 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 49914) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:56:43.405026 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-6ceebc60-50e5-4558-996e-9de126058039 admin admin] 10.222.0.67 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4309 time: 0.0536933 Sep 01 16:56:51.230180 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-0b3064fb-64a2-474e-b9d5-6780b776b4f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:56:53.748287 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:56:53.766242 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-a70f91ef-0f8b-4b3b-994f-3a2bd2519357 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:56:54.866194 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:56:56.385176 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:56:56.501955 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:57:14.536087 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:57:21.231054 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-0a693ede-74eb-4dec-91c4-4188d56bc374 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:57:23.751732 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:57:23.768643 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-46b6a66f-363e-4286-8e30-5b2efd86161c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:57:24.868667 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:57:26.391138 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:57:26.505210 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:57:51.231998 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-d5369a05-9c71-4799-95b6-f691ef2141f9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:57:51.534506 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:57:53.760784 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:57:53.771875 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-48843e11-f13f-4b30-be8b-de53c8df2a8a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:57:54.870601 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:57:56.399835 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:57:56.510835 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:15.505160 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50080) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:15.601504 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50094) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:15.698589 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-291996528-network', 'tenant_id': '7032b30e75954f8da9ad2cb64f1f5ad1'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:15.722033 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Made reservation on behalf of 7032b30e75954f8da9ad2cb64f1f5ad1 for: {'network': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:15.725029 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:15.734484 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:15.830630 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:15.834620 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:15.863972 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] vlan segment allocate from pool success with {'vlan_id': 525, 'physical_network': 'physnet1'} {{(pid=93836) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 16:58:15.869683 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38935e02-4c11-46ba-a92f-003a4524abb5,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:15.878787 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:15.879169 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:15.879522 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:15.879860 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:15.880197 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:15.880535 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:15.880862 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:15.881360 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:15.881912 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:15.882252 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:15.882664 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:15.883066 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Tracked resource versions report: Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: pushed versions: Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: { 'AddressGroup': {'1.2'}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'ConntrackHelper': {'1.0'}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Log': {'1.0'}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Network': {'1.1'}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Port': {'1.7'}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'PortForwarding': {'1.2'}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'QosPolicy': {'1.9'}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'SecurityGroup': {'1.4'}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'SecurityGroupRule': {'1.2'}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'SubPort': {'1.0'}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Subnet': {'1.1'}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Trunk': {'1.1'}} Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: consumer versions: Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: { DHCP agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: HyperV agent@hv-cinder-79966: {}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: L3 agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: Metadata agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: Metering agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: Open vSwitch agent@dv-cinder-799668-16-iscsi: { 'AddressGroup': '1.2', Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'ConntrackHelper': '1.0', Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Log': '1.0', Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Network': '1.1', Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Port': '1.7', Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'PortForwarding': '1.2', Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'QosPolicy': '1.9', Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'SecurityGroup': '1.4', Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'SecurityGroupRule': '1.2', Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'SubPort': '1.0', Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Subnet': '1.1', Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: 'Trunk': '1.1'}} Sep 01 16:58:15.884157 dv-cinder-799668-16-iscsi neutron-server[93836]: {{(pid=93836) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 01 16:58:15.900120 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:15.901098 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.segments_db [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Added segment dc2afa10-206e-4e07-821f-7de675db4aa1 of type vlan for network 8331b65a-166e-454c-a3c5-ed861dc82dfc Sep 01 16:58:15.914031 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-2014485163-network', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:15.957149 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:15.978948 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] Made reservation on behalf of 4199ca0b18374af7856c19238fc2fea1 for: {'network': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:15.981441 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:15.992739 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.010981 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.012147 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:16.013331 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.137091 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] Pushing event updated for resources: {'Network': ['ID=8331b65a-166e-454c-a3c5-ed861dc82dfc,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:16.149783 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network 8331b65a-166e-454c-a3c5-ed861dc82dfc details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 16:58:16.152837 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.157783 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.186475 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=46b214ac-e92f-4309-83a4-7ce8205e9d7a,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:16.194000 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50130) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:16.194489 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-59fa2614-d819-4b8a-a9f9-ab27042aec32 admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6872454 Sep 01 16:58:16.200739 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Request body: {'subnet': {'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-291996528-subnet', 'tenant_id': '7032b30e75954f8da9ad2cb64f1f5ad1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:16.202574 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] vlan segment allocate from pool success with {'vlan_id': 506, 'physical_network': 'physnet1'} {{(pid=93836) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 16:58:16.214971 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.216219 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.segments_db [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] Added segment 9dfcf32c-db95-455a-ac7a-283312e9c7a0 of type vlan for network 63606bb0-66bd-46d6-ba6c-55c6da830865 Sep 01 16:58:16.238846 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Made reservation on behalf of 7032b30e75954f8da9ad2cb64f1f5ad1 for: {'subnet': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:16.241910 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Notify callbacks [] for subnet, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.277879 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.310840 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.312467 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:16.313252 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.378895 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] Pushing event updated for resources: {'Network': ['ID=63606bb0-66bd-46d6-ba6c-55c6da830865,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:16.385837 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-fcb6f354-817d-4c90-abed-7fcd37ea196a admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 0.7824399 Sep 01 16:58:16.387011 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50138) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:16.391791 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network 63606bb0-66bd-46d6-ba6c-55c6da830865 details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 16:58:16.393557 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-ecdbc8a2-62d3-4634-91c9-912e540692b4 admin admin] Request body: {'subnet': {'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-2014485163-subnet', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:16.427284 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ecdbc8a2-62d3-4634-91c9-912e540692b4 admin admin] Made reservation on behalf of 4199ca0b18374af7856c19238fc2fea1 for: {'subnet': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:16.429655 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ecdbc8a2-62d3-4634-91c9-912e540692b4 admin admin] Notify callbacks [] for subnet, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.436797 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for subnet, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.486611 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fd025a14-8839-4451-a03e-bc7daeb612d0,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:16.495531 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:16.495907 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:16.496265 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:16.496608 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:16.497485 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:16.497910 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:16.498257 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:16.498957 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:16.499469 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:16.500702 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:16.501211 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:16.501727 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Tracked resource versions report: Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: pushed versions: Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: { 'AddressGroup': {'1.2'}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'ConntrackHelper': {'1.0'}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Log': {'1.0'}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Network': {'1.1'}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Port': {'1.7'}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'PortForwarding': {'1.2'}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'QosPolicy': {'1.9'}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'SecurityGroup': {'1.4'}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'SecurityGroupRule': {'1.2'}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'SubPort': {'1.0'}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Subnet': {'1.1'}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Trunk': {'1.1'}} Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: consumer versions: Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: { DHCP agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: HyperV agent@hv-cinder-79966: {}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: L3 agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: Metadata agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: Metering agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: Open vSwitch agent@dv-cinder-799668-16-iscsi: { 'AddressGroup': '1.2', Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'ConntrackHelper': '1.0', Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Log': '1.0', Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Network': '1.1', Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Port': '1.7', Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'PortForwarding': '1.2', Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'QosPolicy': '1.9', Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'SecurityGroup': '1.4', Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'SecurityGroupRule': '1.2', Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'SubPort': '1.0', Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Subnet': '1.1', Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: 'Trunk': '1.1'}} Sep 01 16:58:16.503114 dv-cinder-799668-16-iscsi neutron-server[93835]: {{(pid=93835) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 01 16:58:16.507825 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50142) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:16.526588 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50146) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:16.549311 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50150) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:16.561230 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Checking segment: {'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:16.561435 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Network hostable DHCP agents. Network: 8331b65a-166e-454c-a3c5-ed861dc82dfc, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93835) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 16:58:16.583875 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Network 8331b65a-166e-454c-a3c5-ed861dc82dfc is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93835) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 16:58:16.598532 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, 8331b65a-166e-454c-a3c5-ed861dc82dfc) {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:16.607300 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:16.609246 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.611331 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2adfab10-2331-4510-b716-513cf431e20e None None] Network 8331b65a-166e-454c-a3c5-ed861dc82dfc requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:58:16.638680 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-df057701-01b3-41ad-83ef-c8791a4e4712 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.4393923 Sep 01 16:58:16.750137 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ecdbc8a2-62d3-4634-91c9-912e540692b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for subnet, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.760375 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88b7cde0-bdc9-420c-950f-b03902d6d88e None None] Network 8331b65a-166e-454c-a3c5-ed861dc82dfc requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:58:16.818303 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecdbc8a2-62d3-4634-91c9-912e540692b4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fd331d5b-40b1-4163-8537-7af4e56f1efd,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:16.826548 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecdbc8a2-62d3-4634-91c9-912e540692b4 admin admin] Checking segment: {'id': '9dfcf32c-db95-455a-ac7a-283312e9c7a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93836) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:16.826906 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ecdbc8a2-62d3-4634-91c9-912e540692b4 admin admin] Network hostable DHCP agents. Network: 63606bb0-66bd-46d6-ba6c-55c6da830865, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93836) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 16:58:16.829372 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-514440420-network', 'tenant_id': '76cfc4ed03034fdc9e2ce4a3580959f7'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:16.844892 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ecdbc8a2-62d3-4634-91c9-912e540692b4 admin admin] Network 63606bb0-66bd-46d6-ba6c-55c6da830865 is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93836) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 16:58:16.849907 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-112068029-network', 'tenant_id': 'bd3063d078734b61a0fb8e89f35c5a52'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:16.857444 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-ecdbc8a2-62d3-4634-91c9-912e540692b4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, 63606bb0-66bd-46d6-ba6c-55c6da830865) {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:16.875262 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ecdbc8a2-62d3-4634-91c9-912e540692b4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:16.875530 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7936574-cde8-4af2-a126-adf431402dca None None] Network 63606bb0-66bd-46d6-ba6c-55c6da830865 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:58:16.875956 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ecdbc8a2-62d3-4634-91c9-912e540692b4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.882289 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.db.api [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 01 16:58:16.882289 dv-cinder-799668-16-iscsi neutron-server[93835]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Sep 01 16:58:16.882289 dv-cinder-799668-16-iscsi neutron-server[93835]: [parameters: {'project_id_1': 'bd3063d078734b61a0fb8e89f35c5a52', 'expiration_1': datetime.datetime(2021, 9, 1, 16, 58, 16, 864565)}] Sep 01 16:58:16.882289 dv-cinder-799668-16-iscsi neutron-server[93835]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=93835) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Sep 01 16:58:16.882699 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG oslo_db.api [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Sep 01 16:58:16.892611 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] Made reservation on behalf of 76cfc4ed03034fdc9e2ce4a3580959f7 for: {'network': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:16.895775 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.899609 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-ecdbc8a2-62d3-4634-91c9-912e540692b4 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 0.5100963 Sep 01 16:58:16.906528 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:16.906751 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50164) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:16.912973 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-2014485163-router', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:16.929531 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-214033632-network', 'tenant_id': 'af7d370157f84ca198eb86180115a76f'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:17.063353 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.070932 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.082592 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.db.api [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 01 16:58:17.082592 dv-cinder-799668-16-iscsi neutron-server[93836]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Sep 01 16:58:17.082592 dv-cinder-799668-16-iscsi neutron-server[93836]: [parameters: {'project_id_1': 'af7d370157f84ca198eb86180115a76f', 'expiration_1': datetime.datetime(2021, 9, 1, 16, 58, 16, 936730)}] Sep 01 16:58:17.082592 dv-cinder-799668-16-iscsi neutron-server[93836]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=93836) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Sep 01 16:58:17.083095 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG oslo_db.api [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Sep 01 16:58:17.088434 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1827089', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4631'] for router, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.089562 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1833975', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1833092', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1830247', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4608'] for router, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.092560 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc398c04-c3eb-46f3-ba14-3bdcc532c10c None None] Network 63606bb0-66bd-46d6-ba6c-55c6da830865 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:58:17.097316 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] vlan segment allocate from pool success with {'vlan_id': 532, 'physical_network': 'physnet1'} {{(pid=93835) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 16:58:17.108357 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.109070 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.segments_db [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] Added segment 2785b39f-9a72-4d03-a737-382dced1c97a of type vlan for network 4af50d67-ae76-48e9-804b-cf2e7dc7f714 Sep 01 16:58:17.167265 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.179419 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.227387 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=edb52b36-a4c0-45b6-aa6e-81d4764b67ef,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:17.233429 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.234685 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:17.235429 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.333886 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] Pushing event updated for resources: {'Network': ['ID=4af50d67-ae76-48e9-804b-cf2e7dc7f714,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:17.338414 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-cdbd635f-7b6e-48ba-a344-ec12e8d96931 admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.8295739 Sep 01 16:58:17.341434 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50180) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:17.346547 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network 4af50d67-ae76-48e9-804b-cf2e7dc7f714 details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 16:58:17.350037 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-e184ffe8-3626-44c2-ad34-53420c664c22 admin admin] Request body: {'subnet': {'network_id': '4af50d67-ae76-48e9-804b-cf2e7dc7f714', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-514440420-subnet', 'tenant_id': '76cfc4ed03034fdc9e2ce4a3580959f7', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:17.353733 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.378125 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e184ffe8-3626-44c2-ad34-53420c664c22 admin admin] Made reservation on behalf of 76cfc4ed03034fdc9e2ce4a3580959f7 for: {'subnet': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:17.382472 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e184ffe8-3626-44c2-ad34-53420c664c22 admin admin] Notify callbacks [] for subnet, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.468252 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Made reservation on behalf of bd3063d078734b61a0fb8e89f35c5a52 for: {'network': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:17.470821 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.484852 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.610938 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.633405 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.681973 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.709851 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.740145 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Made reservation on behalf of af7d370157f84ca198eb86180115a76f for: {'network': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:17.744102 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.758942 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.772496 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f373fe9-b615-426b-b5b6-0d0d1afcf53f,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:17.781601 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] vlan segment allocate from pool success with {'vlan_id': 503, 'physical_network': 'physnet1'} {{(pid=93835) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 16:58:17.784007 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e184ffe8-3626-44c2-ad34-53420c664c22 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for subnet, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.805849 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Allocated IP 172.27.1.181 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:58:17.857957 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.858367 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.segments_db [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Added segment 4c43d5a2-b8fa-4f22-98d0-f5e58719b79b of type vlan for network 6b2274d5-2da9-45f5-b934-8322fdab0f3f Sep 01 16:58:17.859929 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e184ffe8-3626-44c2-ad34-53420c664c22 admin admin] Checking segment: {'id': '2785b39f-9a72-4d03-a737-382dced1c97a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 532, 'network_id': '4af50d67-ae76-48e9-804b-cf2e7dc7f714'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:17.860294 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e184ffe8-3626-44c2-ad34-53420c664c22 admin admin] Network hostable DHCP agents. Network: 4af50d67-ae76-48e9-804b-cf2e7dc7f714, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93835) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 16:58:17.895718 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e184ffe8-3626-44c2-ad34-53420c664c22 admin admin] Network 4af50d67-ae76-48e9-804b-cf2e7dc7f714 is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93835) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 16:58:17.929653 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-e184ffe8-3626-44c2-ad34-53420c664c22 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, 4af50d67-ae76-48e9-804b-cf2e7dc7f714) {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:17.939589 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e485df8-2153-41ac-8766-952f0da53d42 None None] Network 4af50d67-ae76-48e9-804b-cf2e7dc7f714 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:58:17.955814 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e184ffe8-3626-44c2-ad34-53420c664c22 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:17.956465 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e184ffe8-3626-44c2-ad34-53420c664c22 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.977828 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.981975 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e184ffe8-3626-44c2-ad34-53420c664c22 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9b4a4924-07f0-4c55-a14a-c9f863402ba1,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:17.982870 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.987849 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:17.999991 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:18.015295 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-e184ffe8-3626-44c2-ad34-53420c664c22 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.6718032 Sep 01 16:58:18.016722 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] vlan segment allocate from pool success with {'vlan_id': 544, 'physical_network': 'physnet1'} {{(pid=93836) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 16:58:18.058860 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ab45ad1-bac9-4ede-994c-52c6ec6bb350,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:18.062337 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:18.062782 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.segments_db [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Added segment bec5369a-b830-4662-87e0-2fcfaf3604ff of type vlan for network 2f7bfe5e-0012-467f-ad7f-aea2467233ac Sep 01 16:58:18.067922 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:18.068954 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:18.069723 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:18.133018 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:18.147757 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:18.170062 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] Pushing event updated for resources: {'Network': ['ID=6b2274d5-2da9-45f5-b934-8322fdab0f3f,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:18.182793 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-a8d7c446-d276-435c-9fc9-62bb014940aa admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 1.6548238 Sep 01 16:58:18.183288 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network 6b2274d5-2da9-45f5-b934-8322fdab0f3f details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 16:58:18.186719 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50212) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:18.197101 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-a78a4294-c713-40b1-ba83-41ad26039733 admin admin] Request body: {'subnet': {'network_id': '6b2274d5-2da9-45f5-b934-8322fdab0f3f', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-112068029-subnet', 'tenant_id': 'bd3063d078734b61a0fb8e89f35c5a52', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:18.228911 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e91cdf1-d696-4f4e-8c5f-1365d559b97f None None] Network 4af50d67-ae76-48e9-804b-cf2e7dc7f714 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:58:18.250262 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a78a4294-c713-40b1-ba83-41ad26039733 admin admin] Made reservation on behalf of bd3063d078734b61a0fb8e89f35c5a52 for: {'subnet': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:18.255417 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a78a4294-c713-40b1-ba83-41ad26039733 admin admin] Notify callbacks [] for subnet, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:18.474529 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:58:18.480690 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:18.483323 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:58:18.485145 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:18.486085 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:18.486643 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:18.504216 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Pushing event updated for resources: {'Port': ['ID=f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:18.612544 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] Pushing event updated for resources: {'Network': ['ID=2f7bfe5e-0012-467f-ad7f-aea2467233ac,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:18.623068 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a78a4294-c713-40b1-ba83-41ad26039733 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for subnet, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:18.624818 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50232) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:18.654481 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network 2f7bfe5e-0012-467f-ad7f-aea2467233ac details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 16:58:18.679420 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a78a4294-c713-40b1-ba83-41ad26039733 admin admin] Pushing event updated for resources: {'Subnet': ['ID=da6b4fec-b788-4946-837e-abc1ea5a6e3c,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:18.700358 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a78a4294-c713-40b1-ba83-41ad26039733 admin admin] Checking segment: {'id': '4c43d5a2-b8fa-4f22-98d0-f5e58719b79b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '6b2274d5-2da9-45f5-b934-8322fdab0f3f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:18.700878 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a78a4294-c713-40b1-ba83-41ad26039733 admin admin] Network hostable DHCP agents. Network: 6b2274d5-2da9-45f5-b934-8322fdab0f3f, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93835) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 16:58:18.726428 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-cc2590af-47b7-4e8c-9052-e79e528732d2 admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 2.1733692 Sep 01 16:58:18.727010 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50244) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:18.737045 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-ee4bbb99-b4a7-4fb4-88bd-e409f3a41595 admin admin] Request body: {'subnet': {'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-subnet', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:18.742712 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a78a4294-c713-40b1-ba83-41ad26039733 admin admin] Network 6b2274d5-2da9-45f5-b934-8322fdab0f3f is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93835) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 16:58:18.763980 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-a78a4294-c713-40b1-ba83-41ad26039733 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, 6b2274d5-2da9-45f5-b934-8322fdab0f3f) {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:18.777012 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b7bf68e-d54d-40df-a190-b88ad002d91a None None] Network 6b2274d5-2da9-45f5-b934-8322fdab0f3f requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:58:18.780192 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a78a4294-c713-40b1-ba83-41ad26039733 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:18.780974 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a78a4294-c713-40b1-ba83-41ad26039733 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:18.803933 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee4bbb99-b4a7-4fb4-88bd-e409f3a41595 admin admin] Made reservation on behalf of af7d370157f84ca198eb86180115a76f for: {'subnet': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:18.808430 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ee4bbb99-b4a7-4fb4-88bd-e409f3a41595 admin admin] Notify callbacks [] for subnet, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:18.819243 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-a78a4294-c713-40b1-ba83-41ad26039733 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 0.6272931 Sep 01 16:58:18.932460 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:18.976700 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45413b10-73a3-4c5d-b2c4-0170fdabe198 None None] Network 6b2274d5-2da9-45f5-b934-8322fdab0f3f requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:58:18.991103 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-363f4252-f22d-4879-b31a-77d653c2a3dc admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:19.192480 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-363f4252-f22d-4879-b31a-77d653c2a3dc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:19.206303 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-363f4252-f22d-4879-b31a-77d653c2a3dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:19.219429 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1833934', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1833207'] for router, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:19.288576 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-363f4252-f22d-4879-b31a-77d653c2a3dc admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=3e7a961cc7f345739f27d6f4b206bf3e&name=default HTTP/1.1" status: 200 len: 2975 time: 0.6588013 Sep 01 16:58:19.289086 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50282) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:19.289183 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-363f4252-f22d-4879-b31a-77d653c2a3dc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e5e572c-6ba5-4394-95ca-1b863f068e1b,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:19.423332 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-359ad262-6f0a-45d3-b495-b5dbda69c734 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:19.432423 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ee4bbb99-b4a7-4fb4-88bd-e409f3a41595 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for subnet, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:19.448822 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-359ad262-6f0a-45d3-b495-b5dbda69c734 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:19.521021 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-359ad262-6f0a-45d3-b495-b5dbda69c734 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:19.523504 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-359ad262-6f0a-45d3-b495-b5dbda69c734 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:19.527824 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-359ad262-6f0a-45d3-b495-b5dbda69c734 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/7e5e572c-6ba5-4394-95ca-1b863f068e1b HTTP/1.1" status: 204 len: 168 time: 0.2348239 Sep 01 16:58:19.542021 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-359ad262-6f0a-45d3-b495-b5dbda69c734 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e5e572c-6ba5-4394-95ca-1b863f068e1b,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:19.544143 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee4bbb99-b4a7-4fb4-88bd-e409f3a41595 admin admin] Pushing event updated for resources: {'Subnet': ['ID=58fe425a-6b3e-47bd-b5c0-e68ea7782780,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:19.549713 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee4bbb99-b4a7-4fb4-88bd-e409f3a41595 admin admin] Checking segment: {'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:19.550482 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee4bbb99-b4a7-4fb4-88bd-e409f3a41595 admin admin] Network hostable DHCP agents. Network: 2f7bfe5e-0012-467f-ad7f-aea2467233ac, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93835) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 16:58:19.561064 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Router 4cf8f50e-62df-4689-a6af-1d0b8433f43e is scheduled to L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c with binding_index 1 {{(pid=93836) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 01 16:58:19.577758 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee4bbb99-b4a7-4fb4-88bd-e409f3a41595 admin admin] Network 2f7bfe5e-0012-467f-ad7f-aea2467233ac is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93835) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 16:58:19.598896 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-ee4bbb99-b4a7-4fb4-88bd-e409f3a41595 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, 2f7bfe5e-0012-467f-ad7f-aea2467233ac) {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:19.608626 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01574ae9-2a45-49de-8e07-614fb0a8236c None None] Network 2f7bfe5e-0012-467f-ad7f-aea2467233ac requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:58:19.613946 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee4bbb99-b4a7-4fb4-88bd-e409f3a41595 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:19.614546 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ee4bbb99-b4a7-4fb4-88bd-e409f3a41595 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:19.638300 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-ee4bbb99-b4a7-4fb4-88bd-e409f3a41595 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.9080453 Sep 01 16:58:19.640449 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50300) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:19.647913 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:19.687849 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1827089', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4631'] for router, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:19.693122 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1833975', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1833092', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1830247', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4608'] for router, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:19.771237 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 16:58:19.784904 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Sync routers for ids ['4cf8f50e-62df-4689-a6af-1d0b8433f43e'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 16:58:19.799170 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Routers {'4cf8f50e-62df-4689-a6af-1d0b8433f43e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:58:19.799827 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:57:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['4cf8f50e-62df-4689-a6af-1d0b8433f43e'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:19.810881 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] Notify callbacks [] for router, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:19.815913 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-87ab0e5f-a32d-452c-a2af-836afa4ef22a admin admin] 10.222.0.67 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 2.9045718 Sep 01 16:58:19.817797 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50302) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:19.839197 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50312) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:19.884045 dv-cinder-799668-16-iscsi neutron-server[93836]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 01 16:58:19.901489 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ce91fdb-f9d4-529e-8715-29775a2007ca-2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780'}]}} from dv-cinder-799668-16-iscsi. {{(pid=93837) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 01 16:58:19.902366 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:20.082080 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:20.086156 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Set router 4cf8f50e-62df-4689-a6af-1d0b8433f43e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:58:20.178939 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-8cdb58d5-a4b9-488c-b01f-ac1022d68be3 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:20.180513 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-8cdb58d5-a4b9-488c-b01f-ac1022d68be3 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/networks?id=8331b65a-166e-454c-a3c5-ed861dc82dfc HTTP/1.1" status: 200 len: 814 time: 0.2990825 Sep 01 16:58:20.201735 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.db_base_plugin_common [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Allocated IP 172.20.0.2 (2f7bfe5e-0012-467f-ad7f-aea2467233ac/58fe425a-6b3e-47bd-b5c0-e68ea7782780/9372f287-95c6-4b7b-bfd9-6d01ccd217a8) {{(pid=93837) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:58:20.229824 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50322) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:20.238013 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-7ef80f8c-65d3-4c42-ae1f-631e0e78d70f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/quotas/7032b30e75954f8da9ad2cb64f1f5ad1 HTTP/1.1" status: 200 len: 375 time: 0.0497043 Sep 01 16:58:20.298421 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-39224069-e86a-471f-8050-af79e7e18227 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=7032b30e75954f8da9ad2cb64f1f5ad1&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0536067 Sep 01 16:58:20.545173 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'name': 'tempest-ServerRescueNegativeTestJSON-2014485163-router', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.181'}], 'enable_snat': True}, 'gw_port_id': 'f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T16:58:18Z', 'revision_number': 3, 'project_id': '4199ca0b18374af7856c19238fc2fea1', 'gw_port': {'id': 'f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6d:5a:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 61, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T16:58:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:20.558601 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Notify callbacks [] for port, precommit_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:20.585589 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Transition to ACTIVE for port object 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:58:20.602696 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Checking router: 4cf8f50e-62df-4689-a6af-1d0b8433f43e for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 16:58:20.605206 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Updating router 4cf8f50e-62df-4689-a6af-1d0b8433f43e port f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 binding host dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 16:58:20.610708 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Transition to ACTIVE for port object 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 will not be triggered until provisioned by entity DHCP. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:58:20.621062 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:20.625912 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:20.659364 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:20.696533 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Network 2f7bfe5e-0012-467f-ad7f-aea2467233ac is already hosted by enough agents. {{(pid=93837) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:58:20.703224 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.base_scheduler [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Resources bound (agent type, host, resource id): {{(pid=93837) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:20.707135 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Received port after_create {{(pid=93837) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:58:20.716547 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Pushing event updated for resources: {'Port': ['ID=9372f287-95c6-4b7b-bfd9-6d01ccd217a8,revision_number=1']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:20.776989 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:20.779512 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:20.780051 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:20.780392 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:20.780722 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:20.781052 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:20.783167 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:20.783673 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:20.787309 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:20.787852 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:20.788349 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:20.788846 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Tracked resource versions report: Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: pushed versions: Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: { 'AddressGroup': {'1.2'}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'ConntrackHelper': {'1.0'}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Log': {'1.0'}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Network': {'1.1'}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Port': {'1.7'}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'PortForwarding': {'1.2'}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'QosPolicy': {'1.9'}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'SecurityGroup': {'1.4'}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'SecurityGroupRule': {'1.2'}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'SubPort': {'1.0'}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Subnet': {'1.1'}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Trunk': {'1.1'}} Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: consumer versions: Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: { DHCP agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: HyperV agent@hv-cinder-79966: {}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: L3 agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: Metadata agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: Metering agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: Open vSwitch agent@dv-cinder-799668-16-iscsi: { 'AddressGroup': '1.2', Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'ConntrackHelper': '1.0', Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Log': '1.0', Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Network': '1.1', Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Port': '1.7', Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'PortForwarding': '1.2', Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'QosPolicy': '1.9', Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'SecurityGroup': '1.4', Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'SecurityGroupRule': '1.2', Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'SubPort': '1.0', Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Subnet': '1.1', Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: 'Trunk': '1.1'}} Sep 01 16:58:20.790145 dv-cinder-799668-16-iscsi neutron-server[93837]: {{(pid=93837) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 01 16:58:20.823571 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:20.850046 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Attempting to bind port 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:58:20.850579 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Attempting to bind port 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:58:20.850767 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Attempting to bind port 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 on network 2f7bfe5e-0012-467f-ad7f-aea2467233ac {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:20.866388 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 57, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:58:20.869839 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Checking segment: {'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:20.870414 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:20.870971 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Bound using segment: {'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:58:20.878039 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Bound port: 9372f287-95c6-4b7b-bfd9-6d01ccd217a8, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:58:20.878697 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.006817 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] For port 9372f287-95c6-4b7b-bfd9-6d01ccd217a8, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:58:21.016903 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] For port 9372f287-95c6-4b7b-bfd9-6d01ccd217a8, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=9372f287-95c6-4b7b-bfd9-6d01ccd217a8,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:58:21.022870 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.024385 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50346) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:21.046285 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-46cabdf5-3f30-4b40-b12c-97b798f253e9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.050282 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c3a4e52d-ad31-44de-b54c-2a1cdf3a80a6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.107881 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.129994 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19352e9d-96a8-4285-8018-6743296e0ae6 None None] Pushing event updated for resources: {'Port': ['ID=9372f287-95c6-4b7b-bfd9-6d01ccd217a8,revision_number=2']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:21.171662 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.191646 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c3a4e52d-ad31-44de-b54c-2a1cdf3a80a6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.199495 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c3a4e52d-ad31-44de-b54c-2a1cdf3a80a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.244134 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-71e46ec5-58f1-4757-abae-3b2926ea7da8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.246142 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3a4e52d-ad31-44de-b54c-2a1cdf3a80a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bcd23ef1-ef16-43ff-b25d-757a769cd78e,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:21.254520 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Notify callbacks [] for port, precommit_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.281560 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.provisioning_blocks [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Transition to ACTIVE for port object f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 will not be triggered until provisioned by entity L2. {{(pid=93838) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:58:21.291892 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.315553 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c3a4e52d-ad31-44de-b54c-2a1cdf3a80a6 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=65fb510a74694545ba03fac11bda4564&name=default HTTP/1.1" status: 200 len: 2975 time: 0.2862525 Sep 01 16:58:21.315553 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50350) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:21.366413 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50356) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:21.398032 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Attempting to bind port f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:58:21.398401 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Attempting to bind port f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:58:21.409060 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Attempting to bind port f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 on network e28b8145-06a4-43a8-a9f2-9a7014f96a23 {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:21.424579 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 57, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:58:21.430620 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Checking segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93838) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:21.432005 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.435117 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Bound using segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:58:21.443353 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Bound port: f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:58:21.445960 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.452256 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Pushing event updated for resources: {'Port': ['ID=f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55,revision_number=2']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:21.479008 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:21.479632 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:21.480196 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:21.480759 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:21.481333 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:21.481927 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:21.482660 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:21.483213 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:21.483779 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:21.484327 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:21.484973 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:21.485531 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Tracked resource versions report: Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: pushed versions: Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: { 'AddressGroup': {'1.2'}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'ConntrackHelper': {'1.0'}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Log': {'1.0'}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Network': {'1.1'}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Port': {'1.7'}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'PortForwarding': {'1.2'}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'QosPolicy': {'1.9'}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'SecurityGroup': {'1.4'}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'SecurityGroupRule': {'1.2'}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'SubPort': {'1.0'}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Subnet': {'1.1'}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Trunk': {'1.1'}} Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: consumer versions: Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: { DHCP agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: HyperV agent@hv-cinder-79966: {}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: L3 agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: Metadata agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: Metering agent@dv-cinder-799668-16-iscsi: {}, Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: Open vSwitch agent@dv-cinder-799668-16-iscsi: { 'AddressGroup': '1.2', Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'ConntrackHelper': '1.0', Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Log': '1.0', Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Network': '1.1', Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Port': '1.7', Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'PortForwarding': '1.2', Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'QosPolicy': '1.9', Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'SecurityGroup': '1.4', Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'SecurityGroupRule': '1.2', Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'SubPort': '1.0', Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Subnet': '1.1', Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: 'Trunk': '1.1'}} Sep 01 16:58:21.489824 dv-cinder-799668-16-iscsi neutron-server[93838]: {{(pid=93838) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 01 16:58:21.520811 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50360) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:21.537186 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-b5c2f735-c0c7-4900-985c-346a701712fb service neutron] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93836) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 16:58:21.538273 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-b5c2f735-c0c7-4900-985c-346a701712fb service neutron] 10.222.0.67 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3031766 Sep 01 16:58:21.548764 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] For port f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93838) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:58:21.552610 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1469086826-network', 'tenant_id': '2339fbb956884b75975749e714a7e63c'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:21.553191 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] For port f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93838) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:58:21.556707 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Allocated IP 172.20.0.1 (63606bb0-66bd-46d6-ba6c-55c6da830865/fd331d5b-40b1-4163-8537-7af4e56f1efd/c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:58:21.559105 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.573431 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f65ea341-0c0f-4e58-bf21-3ba81ca42fe7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.584621 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-46cabdf5-3f30-4b40-b12c-97b798f253e9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.598205 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-46cabdf5-3f30-4b40-b12c-97b798f253e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.601433 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Allocated IP 172.27.1.112 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/451f37bd-beb9-4944-a58c-21316e8aa987) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:58:21.620386 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae489a4d-2947-4900-929f-c6c7a6e0995a None None] Pushing event updated for resources: {'Port': ['ID=f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55,revision_number=3']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:21.652935 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Routers {'4cf8f50e-62df-4689-a6af-1d0b8433f43e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:58:21.655565 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:57:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['4cf8f50e-62df-4689-a6af-1d0b8433f43e'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:21.681061 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-46cabdf5-3f30-4b40-b12c-97b798f253e9 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=c442d169b25c4bb1b11c9a5a0dff7784&name=default HTTP/1.1" status: 200 len: 2975 time: 1.4477823 Sep 01 16:58:21.681061 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46cabdf5-3f30-4b40-b12c-97b798f253e9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ff97c24-0e85-4a4e-b4e5-1a676b23ab19,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:21.691911 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50370) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:21.697375 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f65ea341-0c0f-4e58-bf21-3ba81ca42fe7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.788730 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3726ec20-614f-4c65-9308-4414581823b8 req-9d3440b7-48e2-41da-8a9a-d7fd448d147d tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:21.791269 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-9d3440b7-48e2-41da-8a9a-d7fd448d147d tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/networks?id=4af50d67-ae76-48e9-804b-cf2e7dc7f714 HTTP/1.1" status: 200 len: 811 time: 0.4221992 Sep 01 16:58:21.809696 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] Set router 4cf8f50e-62df-4689-a6af-1d0b8433f43e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:58:21.815934 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-45aa3ca3-7810-41f2-a9ac-74ce50d435f8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.829377 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.869187 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-45aa3ca3-7810-41f2-a9ac-74ce50d435f8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.885442 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] Made reservation on behalf of 2339fbb956884b75975749e714a7e63c for: {'network': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:21.889468 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.920750 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f65ea341-0c0f-4e58-bf21-3ba81ca42fe7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.923577 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f65ea341-0c0f-4e58-bf21-3ba81ca42fe7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.925426 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-f65ea341-0c0f-4e58-bf21-3ba81ca42fe7 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/bcd23ef1-ef16-43ff-b25d-757a769cd78e HTTP/1.1" status: 204 len: 168 time: 0.6088912 Sep 01 16:58:21.947214 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f65ea341-0c0f-4e58-bf21-3ba81ca42fe7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bcd23ef1-ef16-43ff-b25d-757a769cd78e,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:21.958839 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:21.968806 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-cbdfb0ab-c1c9-43f5-8467-835d567297ee tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/quotas/76cfc4ed03034fdc9e2ce4a3580959f7 HTTP/1.1" status: 200 len: 375 time: 0.1142089 Sep 01 16:58:21.976650 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:22.067225 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-45aa3ca3-7810-41f2-a9ac-74ce50d435f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:22.071741 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-45aa3ca3-7810-41f2-a9ac-74ce50d435f8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:22.072151 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-45aa3ca3-7810-41f2-a9ac-74ce50d435f8 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/6ff97c24-0e85-4a4e-b4e5-1a676b23ab19 HTTP/1.1" status: 204 len: 168 time: 0.3788857 Sep 01 16:58:22.092093 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:58:22.104611 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:22.108314 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:58:22.136428 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'name': 'tempest-ServerRescueNegativeTestJSON-2014485163-router', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.181'}], 'enable_snat': True}, 'gw_port_id': 'f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T16:58:18Z', 'revision_number': 3, 'project_id': '4199ca0b18374af7856c19238fc2fea1', 'gw_port': {'id': 'f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6d:5a:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 61, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T16:58:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:22.149102 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45aa3ca3-7810-41f2-a9ac-74ce50d435f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ff97c24-0e85-4a4e-b4e5-1a676b23ab19,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:22.200284 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:22.203466 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0ce8252-9b62-4084-848b-6ef83c7b0606 None None] The sync data for ids ['4cf8f50e-62df-4689-a6af-1d0b8433f43e'] in dv-cinder-799668-16-iscsi is: [{'id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'name': 'tempest-ServerRescueNegativeTestJSON-2014485163-router', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.181'}], 'enable_snat': True}, 'gw_port_id': 'f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T16:58:18Z', 'revision_number': 3, 'project_id': '4199ca0b18374af7856c19238fc2fea1', 'gw_port': {'id': 'f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6d:5a:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 61, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T16:58:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 16:58:22.204252 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Pushing event updated for resources: {'Port': ['ID=451f37bd-beb9-4944-a58c-21316e8aa987,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:22.231807 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-b9c2eb2f-bb23-4a47-bc57-6c51e564c2dd tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=76cfc4ed03034fdc9e2ce4a3580959f7&fields=id HTTP/1.1" status: 200 len: 210 time: 0.2361238 Sep 01 16:58:22.282896 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-e9c6c630-29f0-489f-be47-bdcb0175286a service neutron] 10.222.0.67 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7236083 Sep 01 16:58:22.398576 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:58:22.507472 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:58:22.532775 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-260296b9-796e-4e4c-97f5-6d48049c0862 service neutron] 10.222.0.67 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2372324 Sep 01 16:58:22.533815 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:22.605198 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Network 63606bb0-66bd-46d6-ba6c-55c6da830865 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:58:22.616832 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:22.619379 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:58:22.619847 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1827972'] for router_interface, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:22.630080 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:22.704119 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:22.706990 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Pushing event updated for resources: {'Port': ['ID=c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:22.770669 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23bf827f-68ec-4244-82e2-64a24babd86b None None] Network 2f7bfe5e-0012-467f-ad7f-aea2467233ac requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:58:22.811190 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-4084653c-d9f1-4d8d-9df6-9ba00b94fb8e service neutron] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93836) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 16:58:22.812326 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-4084653c-d9f1-4d8d-9df6-9ba00b94fb8e service neutron] 10.222.0.67 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.2094533 Sep 01 16:58:22.929979 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-91555e57-cb6e-4fa9-979d-c8d557a1962f None None] Provisioning for port 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:58:22.940036 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] vlan segment allocate from pool success with {'vlan_id': 511, 'physical_network': 'physnet1'} {{(pid=93836) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 16:58:22.950736 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-91555e57-cb6e-4fa9-979d-c8d557a1962f None None] Provisioning complete for port 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:22.951445 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-91555e57-cb6e-4fa9-979d-c8d557a1962f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:23.008115 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50404) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:23.162268 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:23.162610 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.segments_db [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] Added segment bde3412a-46b2-40ca-999f-16c1a142f381 of type vlan for network 28f1402b-614b-4d64-8877-fc91e3ab0ed5 Sep 01 16:58:23.174001 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b503082-1605-424c-b6ef-da7a6695486a,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:23.174239 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:23.242149 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-929247fa-e4f3-4118-a4bb-a558fff241a1 req-35bcc749-5405-4f64-ace3-113b9dcfc741 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 210 time: 0.1338620 Sep 01 16:58:23.243002 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e4c10d03-7045-474c-a355-0bee5e6e8dc3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:23.399967 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-91555e57-cb6e-4fa9-979d-c8d557a1962f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:23.509161 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-91555e57-cb6e-4fa9-979d-c8d557a1962f None None] For port 9372f287-95c6-4b7b-bfd9-6d01ccd217a8, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=9372f287-95c6-4b7b-bfd9-6d01ccd217a8,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:58:23.514800 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-91555e57-cb6e-4fa9-979d-c8d557a1962f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:23.576528 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:23.618806 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:23.627759 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-81e1063a-a3e4-4dc3-82f6-1f72383910d6 service neutron] 10.222.0.67 "GET /v2.0/networks/4af50d67-ae76-48e9-804b-cf2e7dc7f714?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7686517 Sep 01 16:58:23.676008 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91555e57-cb6e-4fa9-979d-c8d557a1962f None None] Pushing event updated for resources: {'Port': ['ID=9372f287-95c6-4b7b-bfd9-6d01ccd217a8,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:23.691661 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1833934', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1833207'] for router, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:23.726979 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e4c10d03-7045-474c-a355-0bee5e6e8dc3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:23.767531 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e4c10d03-7045-474c-a355-0bee5e6e8dc3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:23.791947 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:23.833376 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7aeaa9f8-59c2-419c-88b5-e324226063d4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:23.900109 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:23.904277 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:23.905629 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:24.033507 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e is scheduled to L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c with binding_index 1 {{(pid=93835) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 01 16:58:24.045887 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] Pushing event updated for resources: {'Network': ['ID=28f1402b-614b-4d64-8877-fc91e3ab0ed5,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:24.051246 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-ff02569b-837f-4781-9d91-219940e6bc2f None None] Provisioning complete for port 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:24.052435 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-ff02569b-837f-4781-9d91-219940e6bc2f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:24.077804 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network 28f1402b-614b-4d64-8877-fc91e3ab0ed5 details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 16:58:24.169691 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-e4c10d03-7045-474c-a355-0bee5e6e8dc3 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=78f8ad8e03614ac9ab4d8ec1d6365e90&name=default HTTP/1.1" status: 200 len: 2979 time: 1.1493700 Sep 01 16:58:24.180197 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4c10d03-7045-474c-a355-0bee5e6e8dc3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=032edfbb-d641-49aa-976b-ca9a0db7f663,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:24.188405 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-965e8c23-ac29-4e63-80b8-b8d422b00741 admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 2.6567969 Sep 01 16:58:24.191253 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50454) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:24.194254 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50458) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:24.208740 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 16:58:24.215343 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-75162447-508a-4595-94b8-a71f0513dc5c admin admin] Request body: {'subnet': {'network_id': '28f1402b-614b-4d64-8877-fc91e3ab0ed5', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1469086826-subnet', 'tenant_id': '2339fbb956884b75975749e714a7e63c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:24.231955 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] Notify callbacks [] for router, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:24.233585 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-5de7a4d9-4266-44fd-80f2-f855f0e24234 admin admin] 10.222.0.67 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 4.5920982 Sep 01 16:58:24.239175 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50462) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:24.252110 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Sync routers for ids ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 16:58:24.301016 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Routers {'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:58:24.304094 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:58:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:24.572525 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:58:24.805585 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Set router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:58:24.808140 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-599fdcbf-a457-4a02-b8a9-168c2a44561b req-dc64c689-9605-4a2a-9f2b-291495ced314 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 210 time: 0.0527709 Sep 01 16:58:24.854179 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-8c584d95-b065-48ab-b4d7-bbfcc06df0f9 service neutron] 10.222.0.67 "GET /v2.0/networks/4af50d67-ae76-48e9-804b-cf2e7dc7f714?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.1701169 Sep 01 16:58:24.860781 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8b6b5707-3eac-4b1b-be51-b11d7d759a6b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:24.889033 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8b6b5707-3eac-4b1b-be51-b11d7d759a6b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:24.899340 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:58:24.923447 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:24.924118 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:24.954024 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75162447-508a-4595-94b8-a71f0513dc5c admin admin] Made reservation on behalf of 2339fbb956884b75975749e714a7e63c for: {'subnet': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:24.956670 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-75162447-508a-4595-94b8-a71f0513dc5c admin admin] Notify callbacks [] for subnet, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:24.989682 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:25.078398 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:25.162533 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8b6b5707-3eac-4b1b-be51-b11d7d759a6b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:25.166017 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8b6b5707-3eac-4b1b-be51-b11d7d759a6b admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:25.167365 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-8b6b5707-3eac-4b1b-be51-b11d7d759a6b admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/032edfbb-d641-49aa-976b-ca9a0db7f663 HTTP/1.1" status: 204 len: 168 time: 0.9673808 Sep 01 16:58:25.196441 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:25.237858 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b6b5707-3eac-4b1b-be51-b11d7d759a6b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=032edfbb-d641-49aa-976b-ca9a0db7f663,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:25.320054 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:58:25.363481 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-75162447-508a-4595-94b8-a71f0513dc5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for subnet, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:25.393488 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:25.394958 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:58:25.442969 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Allocated IP 172.20.0.1 (2f7bfe5e-0012-467f-ad7f-aea2467233ac/58fe425a-6b3e-47bd-b5c0-e68ea7782780/99045034-e927-44d2-85d3-7df40bb8cb9b) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:58:25.536555 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:25.553108 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:25.553821 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:25.586332 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:22Z', 'revision_number': 3, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:25.628354 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Checking router: e95cfaf6-7dbf-4e42-af63-5c1ea40c693e for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 16:58:25.628717 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Updating router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e port 451f37bd-beb9-4944-a58c-21316e8aa987 binding host dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 16:58:25.660812 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:25.735426 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f0a913d7-bb2e-4f8e-9e38-25bbc40ea37f req-e7634523-5408-4c98-8280-ed6d38c3d54b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 210 time: 0.2701960 Sep 01 16:58:25.786921 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:25.803043 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75162447-508a-4595-94b8-a71f0513dc5c admin admin] Pushing event updated for resources: {'Subnet': ['ID=3d190f80-a93f-4830-8632-342cc44d5338,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:25.829195 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75162447-508a-4595-94b8-a71f0513dc5c admin admin] Checking segment: {'id': 'bde3412a-46b2-40ca-999f-16c1a142f381', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '28f1402b-614b-4d64-8877-fc91e3ab0ed5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93836) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:25.829677 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75162447-508a-4595-94b8-a71f0513dc5c admin admin] Network hostable DHCP agents. Network: 28f1402b-614b-4d64-8877-fc91e3ab0ed5, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93836) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 16:58:25.834643 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Transition to ACTIVE for port object 99045034-e927-44d2-85d3-7df40bb8cb9b will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:58:25.847364 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Notify callbacks [] for port, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:25.872775 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:25.874059 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611336', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1832500'] for router_interface, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:25.924320 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:25.969092 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75162447-508a-4595-94b8-a71f0513dc5c admin admin] Network 28f1402b-614b-4d64-8877-fc91e3ab0ed5 is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93836) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 16:58:25.984081 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Pushing event updated for resources: {'Port': ['ID=c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5,revision_number=2']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:25.991212 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-75162447-508a-4595-94b8-a71f0513dc5c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, 28f1402b-614b-4d64-8877-fc91e3ab0ed5) {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:26.007939 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75162447-508a-4595-94b8-a71f0513dc5c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:26.008917 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-75162447-508a-4595-94b8-a71f0513dc5c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:26.018307 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0e4cd7c-2dda-4c10-bb20-b96605ca5003 None None] Network 28f1402b-614b-4d64-8877-fc91e3ab0ed5 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:58:26.045091 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Pushing event updated for resources: {'Port': ['ID=99045034-e927-44d2-85d3-7df40bb8cb9b,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:26.057438 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-75162447-508a-4595-94b8-a71f0513dc5c admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.8516624 Sep 01 16:58:26.057649 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Network 2f7bfe5e-0012-467f-ad7f-aea2467233ac is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:58:26.068033 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:26.074163 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:58:26.075791 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1827972'] for router_interface, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:26.164635 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Network 63606bb0-66bd-46d6-ba6c-55c6da830865 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:58:26.167022 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:26.404655 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:58:26.429379 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.69', 52049) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:26.514598 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5ce4490b-0fbd-4fba-b5ea-47ebe711b0fd req-a5a6fcc7-8dbf-4e26-9318-030c9e38304d tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 210 time: 0.0840518 Sep 01 16:58:26.518428 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50578) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:26.843795 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Router 4cf8f50e-62df-4689-a6af-1d0b8433f43e has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 16:58:26.854420 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Notify callbacks [] for port, precommit_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:26.871393 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Transition to ACTIVE for port object 451f37bd-beb9-4944-a58c-21316e8aa987 will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:58:26.980012 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:26.993571 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f5237ace-5873-4e66-a8b5-dff6cf8268b1 req-7b2af8f4-d514-4cb6-a8b5-df3432e25e81 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 210 time: 0.0836000 Sep 01 16:58:27.072559 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:27.073482 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.103173 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50610) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:27.103961 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.127490 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-366b8582-645d-45f4-bce3-b88233c65af7 None None] Network 28f1402b-614b-4d64-8877-fc91e3ab0ed5 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:58:27.136869 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_v2 [None req-ef94bdff-ca4e-49e4-98f2-757ad642e033 admin admin] Deleting subnet da6b4fec-b788-4946-837e-abc1ea5a6e3c {{(pid=93836) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 16:58:27.144946 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ef94bdff-ca4e-49e4-98f2-757ad642e033 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.265528 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-e6973964-12d9-4054-8916-44d04e510e4f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:27.267322 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-e6973964-12d9-4054-8916-44d04e510e4f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "GET /v2.0/networks?id=8331b65a-166e-454c-a3c5-ed861dc82dfc HTTP/1.1" status: 200 len: 814 time: 0.8355618 Sep 01 16:58:27.283359 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71890467-7066-4d8c-b56e-011cd10dce69 None None] Pushing event updated for resources: {'Port': ['ID=451f37bd-beb9-4944-a58c-21316e8aa987,revision_number=2']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:27.347574 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 16:58:27.350703 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ef94bdff-ca4e-49e4-98f2-757ad642e033 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.359861 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Sync routers for ids ['4cf8f50e-62df-4689-a6af-1d0b8433f43e'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 16:58:27.366158 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f5b90583-b150-40fc-aff9-fe536fb724c5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Request body: {'port': {'device_id': '1bb80ba2-8b84-49d5-b868-889e3b7b8630', 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc', 'admin_state_up': True, 'tenant_id': '7032b30e75954f8da9ad2cb64f1f5ad1'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:27.380079 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Routers {'4cf8f50e-62df-4689-a6af-1d0b8433f43e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:58:27.381318 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:58:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['4cf8f50e-62df-4689-a6af-1d0b8433f43e'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:27.441953 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.445213 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-fd8aefd6-135e-4520-9046-df15804e29cf admin admin] 10.222.0.67 "PUT /v2.0/routers/4cf8f50e-62df-4689-a6af-1d0b8433f43e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.6261148 Sep 01 16:58:27.458310 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.460155 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611336', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1832500'] for router_interface, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.488243 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.531771 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.539906 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-ae96f582-3674-435d-9d45-f530f3e78454 None None] Provisioning for port 99045034-e927-44d2-85d3-7df40bb8cb9b completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:58:27.550826 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Attempting to bind port 451f37bd-beb9-4944-a58c-21316e8aa987 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:58:27.553608 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Attempting to bind port 451f37bd-beb9-4944-a58c-21316e8aa987 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:58:27.554194 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Attempting to bind port 451f37bd-beb9-4944-a58c-21316e8aa987 on network e28b8145-06a4-43a8-a9f2-9a7014f96a23 {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:27.586243 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 58, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:58:27.586963 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Checking segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:27.587543 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.588522 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Bound using segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:58:27.589195 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Bound port: 451f37bd-beb9-4944-a58c-21316e8aa987, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:58:27.589808 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.634927 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ef94bdff-ca4e-49e4-98f2-757ad642e033 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.671843 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] For port 451f37bd-beb9-4944-a58c-21316e8aa987, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:58:27.677331 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] For port 451f37bd-beb9-4944-a58c-21316e8aa987, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=451f37bd-beb9-4944-a58c-21316e8aa987,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:58:27.688731 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-ae96f582-3674-435d-9d45-f530f3e78454 None None] Provisioning complete for port 99045034-e927-44d2-85d3-7df40bb8cb9b triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:27.690315 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-ae96f582-3674-435d-9d45-f530f3e78454 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.703269 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.784283 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-034699b5-b16b-4806-bc1c-6df8bb700006 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:27.875599 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Network 2f7bfe5e-0012-467f-ad7f-aea2467233ac is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:58:27.881799 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Pushing event updated for resources: {'Port': ['ID=99045034-e927-44d2-85d3-7df40bb8cb9b,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:27.893142 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4d8b20a6-1bec-41a8-8b57-5ac83600b77e req-160e8428-d40a-48c0-bd08-850ad13d1860 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 210 time: 0.0994651 Sep 01 16:58:27.925311 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:27.945197 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Routers {'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:58:27.947062 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:58:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:28.065696 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-ae96f582-3674-435d-9d45-f530f3e78454 None None] Port 99045034-e927-44d2-85d3-7df40bb8cb9b cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 16:58:28.151315 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71890467-7066-4d8c-b56e-011cd10dce69 None None] Pushing event updated for resources: {'Port': ['ID=451f37bd-beb9-4944-a58c-21316e8aa987,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:28.331223 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.69', 52058) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:28.347880 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Set router 4cf8f50e-62df-4689-a6af-1d0b8433f43e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:58:28.417517 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] Set router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:58:28.588966 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ef94bdff-ca4e-49e4-98f2-757ad642e033 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for subnet, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:28.604284 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:58:28.837672 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef94bdff-ca4e-49e4-98f2-757ad642e033 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=da6b4fec-b788-4946-837e-abc1ea5a6e3c,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:28.859392 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ef94bdff-ca4e-49e4-98f2-757ad642e033 admin admin] Notify callbacks [] for subnet, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:28.895111 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-ef94bdff-ca4e-49e4-98f2-757ad642e033 admin admin] 10.222.0.67 "DELETE /v2.0/subnets/da6b4fec-b788-4946-837e-abc1ea5a6e3c HTTP/1.1" status: 204 len: 168 time: 2.3284566 Sep 01 16:58:28.904798 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50678) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:29.001843 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3998e75d-b432-4ede-8132-560fb7899d29 req-901fb588-b64c-4ed3-9a41-eb92d6357318 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 210 time: 0.3463762 Sep 01 16:58:29.119268 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 16:58:29.191249 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'name': 'tempest-ServerRescueNegativeTestJSON-2014485163-router', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.181'}], 'enable_snat': True}, 'gw_port_id': 'f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T16:58:23Z', 'revision_number': 4, 'project_id': '4199ca0b18374af7856c19238fc2fea1', 'gw_port': {'id': 'f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6d:5a:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 61, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T16:58:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5', 'name': '', 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1', 'mac_address': 'fa:16:3e:f4:21:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'fd331d5b-40b1-4163-8537-7af4e56f1efd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:20Z', 'updated_at': '2021-09-01T16:58:24Z', 'revision_number': 2, 'project_id': '4199ca0b18374af7856c19238fc2fea1', 'subnets': [{'id': 'fd331d5b-40b1-4163-8537-7af4e56f1efd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:29.237222 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-abeb2813-6523-4c36-a3dd-a604ee02d416 None None] Provisioning complete for port 99045034-e927-44d2-85d3-7df40bb8cb9b triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:29.242702 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-abeb2813-6523-4c36-a3dd-a604ee02d416 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:29.337607 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Checking router: 4cf8f50e-62df-4689-a6af-1d0b8433f43e for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 16:58:29.338015 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Updating router 4cf8f50e-62df-4689-a6af-1d0b8433f43e port c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 binding host dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 16:58:29.418302 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:29.429137 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:29.436855 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-abeb2813-6523-4c36-a3dd-a604ee02d416 None None] Port 99045034-e927-44d2-85d3-7df40bb8cb9b cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 16:58:29.452558 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f44a4c34-cf1f-48b6-adad-fe8879a8d143 req-3131d3f0-4b1f-4c3b-917d-fefceffcd113 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 210 time: 0.0672591 Sep 01 16:58:29.457179 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3726ec20-614f-4c65-9308-4414581823b8 req-8a2ee3d1-8186-4fbc-ba71-1d2a05396f4e tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:29.459030 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-8a2ee3d1-8186-4fbc-ba71-1d2a05396f4e tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.69 "GET /v2.0/networks?id=4af50d67-ae76-48e9-804b-cf2e7dc7f714 HTTP/1.1" status: 200 len: 811 time: 1.1268690 Sep 01 16:58:29.486210 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-034699b5-b16b-4806-bc1c-6df8bb700006 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:29.527461 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-034699b5-b16b-4806-bc1c-6df8bb700006 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:29.553083 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:27Z', 'revision_number': 2, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:29.567307 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f5b90583-b150-40fc-aff9-fe536fb724c5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Made reservation on behalf of 7032b30e75954f8da9ad2cb64f1f5ad1 for: {'port': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:29.585075 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f5b90583-b150-40fc-aff9-fe536fb724c5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:29.594904 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-034699b5-b16b-4806-bc1c-6df8bb700006 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=42c3587683834da08a39cffa01832f1e&name=default HTTP/1.1" status: 200 len: 2979 time: 2.4855702 Sep 01 16:58:29.596477 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-3726ec20-614f-4c65-9308-4414581823b8 req-4770f623-8b21-44fb-9cdd-89b1da6dc86b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Request body: {'port': {'device_id': 'e18ee49e-3bbd-4cca-ae7e-0185ef0d225c', 'network_id': '4af50d67-ae76-48e9-804b-cf2e7dc7f714', 'admin_state_up': True, 'tenant_id': '76cfc4ed03034fdc9e2ce4a3580959f7'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:29.630008 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb0655ef-bd9a-4d0f-9841-3f85efad2658 None None] The sync data for ids ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'] in dv-cinder-799668-16-iscsi is: [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:27Z', 'revision_number': 2, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 16:58:29.648201 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50700) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:29.706997 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a827f03a-f203-46bc-b574-d22f6755a408 req-361be33b-ac0a-4cb7-93e2-4f4a0d5f4311 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:29.719983 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a827f03a-f203-46bc-b574-d22f6755a408 req-361be33b-ac0a-4cb7-93e2-4f4a0d5f4311 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/networks?id=63606bb0-66bd-46d6-ba6c-55c6da830865 HTTP/1.1" status: 200 len: 819 time: 0.4661040 Sep 01 16:58:29.781334 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a827f03a-f203-46bc-b574-d22f6755a408 req-5ca89161-ccb2-4ba4-9f1b-dcda878acb10 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/quotas/4199ca0b18374af7856c19238fc2fea1 HTTP/1.1" status: 200 len: 375 time: 0.0579135 Sep 01 16:58:30.026496 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Notify callbacks [] for port, precommit_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:30.041005 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.provisioning_blocks [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Transition to ACTIVE for port object c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 will not be triggered until provisioned by entity L2. {{(pid=93838) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:58:30.051534 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:30.452665 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95b296b1-9801-44a2-8b2e-4bd8940fea5b None None] Pushing event updated for resources: {'Port': ['ID=c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5,revision_number=3']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:30.452665 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Attempting to bind port c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:58:30.452665 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Attempting to bind port c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '9dfcf32c-db95-455a-ac7a-283312e9c7a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865'}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:58:30.452665 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Attempting to bind port c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 on network 63606bb0-66bd-46d6-ba6c-55c6da830865 {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:30.520440 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3726ec20-614f-4c65-9308-4414581823b8 req-4770f623-8b21-44fb-9cdd-89b1da6dc86b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Made reservation on behalf of 76cfc4ed03034fdc9e2ce4a3580959f7 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:30.522313 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 58, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:58:30.522313 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Checking segment: {'id': '9dfcf32c-db95-455a-ac7a-283312e9c7a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93838) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:30.522313 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:30.522313 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Bound using segment: {'id': '9dfcf32c-db95-455a-ac7a-283312e9c7a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865'} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:58:30.522313 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Bound port: c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9dfcf32c-db95-455a-ac7a-283312e9c7a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865'}}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:58:30.522313 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:30.526066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3726ec20-614f-4c65-9308-4414581823b8 req-4770f623-8b21-44fb-9cdd-89b1da6dc86b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:30.526066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-034699b5-b16b-4806-bc1c-6df8bb700006 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5026565c-1ffb-47d7-bede-441247e82e45,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:30.526066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:30.526066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Subscribe: > segment before_delete 55550000 {{(pid=93835) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:58:30.526066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=93835) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:58:30.526066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=93835) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:58:30.526066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Subscribe: > port after_create 55550000 {{(pid=93835) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:58:30.526066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Subscribe: > port after_delete 55550000 {{(pid=93835) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:58:30.526066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Subscribe: > port after_update 55550000 {{(pid=93835) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:58:30.526066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Subscribe: > segment after_delete 55550000 {{(pid=93835) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:58:30.526066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Subscribe: > subnet after_create 55550000 {{(pid=93835) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:58:30.526066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=93835) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:58:30.526066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Subscribe: > subnet after_update 55550000 {{(pid=93835) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:58:30.552670 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] For port c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93838) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:58:30.565233 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] For port c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5,segment=NetworkSegment(9dfcf32c-db95-455a-ac7a-283312e9c7a0),segment_id=9dfcf32c-db95-455a-ac7a-283312e9c7a0)] {{(pid=93838) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:58:30.582863 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:30.758554 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95b296b1-9801-44a2-8b2e-4bd8940fea5b None None] Pushing event updated for resources: {'Port': ['ID=c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5,revision_number=4']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:30.786226 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f5b90583-b150-40fc-aff9-fe536fb724c5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Allocated IP 172.20.0.9 (8331b65a-166e-454c-a3c5-ed861dc82dfc/fd025a14-8839-4451-a03e-bc7daeb612d0/3890e11d-5295-488a-9033-9814bb94bf69) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:58:30.814021 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Routers {'4cf8f50e-62df-4689-a6af-1d0b8433f43e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:58:30.815353 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:58:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['4cf8f50e-62df-4689-a6af-1d0b8433f43e'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:31.096734 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] Set router 4cf8f50e-62df-4689-a6af-1d0b8433f43e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:58:31.116226 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a827f03a-f203-46bc-b574-d22f6755a408 req-7cbb8523-ccfa-48d5-956b-e3432e1e025c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=4199ca0b18374af7856c19238fc2fea1&fields=id HTTP/1.1" status: 200 len: 255 time: 1.3324251 Sep 01 16:58:31.157763 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-78c60b5c-3d31-47c6-a63e-75bb1348a1b8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:31.169059 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Subscribe: > subnet after_create 55550000 {{(pid=93835) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:58:31.170503 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=93835) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:58:31.171439 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Subscribe: > subnet before_create 55550000 {{(pid=93835) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:58:31.172553 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Subscribe: > subnet before_update 55550000 {{(pid=93835) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:58:31.173834 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6b2274d5-2da9-45f5-b934-8322fdab0f3f']}} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:31.215289 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-78c60b5c-3d31-47c6-a63e-75bb1348a1b8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:31.247982 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4c43d5a2-b8fa-4f22-98d0-f5e58719b79b') {'for_net_delete': True} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:31.248549 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4c43d5a2-b8fa-4f22-98d0-f5e58719b79b') {} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:31.294438 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8d2b2151-c5e0-40f8-b184-d4bb000284af req-2fe3ce7f-9f28-4f98-a277-2c725aec0f3c tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 210 time: 0.2928457 Sep 01 16:58:31.375531 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-78c60b5c-3d31-47c6-a63e-75bb1348a1b8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:31.380142 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-78c60b5c-3d31-47c6-a63e-75bb1348a1b8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:31.381430 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-78c60b5c-3d31-47c6-a63e-75bb1348a1b8 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/5026565c-1ffb-47d7-bede-441247e82e45 HTTP/1.1" status: 204 len: 168 time: 1.7267740 Sep 01 16:58:31.391642 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f5b90583-b150-40fc-aff9-fe536fb724c5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:31.529302 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 16:58:31.530104 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'name': 'tempest-ServerRescueNegativeTestJSON-2014485163-router', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.181'}], 'enable_snat': True}, 'gw_port_id': 'f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T16:58:23Z', 'revision_number': 4, 'project_id': '4199ca0b18374af7856c19238fc2fea1', 'gw_port': {'id': 'f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6d:5a:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 61, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T16:58:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5', 'name': '', 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1', 'mac_address': 'fa:16:3e:f4:21:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'fd331d5b-40b1-4163-8537-7af4e56f1efd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:20Z', 'updated_at': '2021-09-01T16:58:30Z', 'revision_number': 4, 'project_id': '4199ca0b18374af7856c19238fc2fea1', 'subnets': [{'id': 'fd331d5b-40b1-4163-8537-7af4e56f1efd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:31.533739 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8197639'] for segment, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:31.542741 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-a8a98c5c-7d5d-43de-b226-04c1164fef93 admin admin] 10.222.0.67 "PUT /v2.0/routers/e95cfaf6-7dbf-4e42-af63-5c1ea40c693e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.3018725 Sep 01 16:58:31.599393 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d3489ca2-9a86-4fe6-9035-9ce94aceab86 req-d3528a8d-16c7-430a-b396-ec1e4f5d4552 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 210 time: 0.1286786 Sep 01 16:58:31.614237 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f5b90583-b150-40fc-aff9-fe536fb724c5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:31.616039 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02bbf0b1-179f-4d7d-bc6c-fcbf3254b8ad None None] The sync data for ids ['4cf8f50e-62df-4689-a6af-1d0b8433f43e'] in dv-cinder-799668-16-iscsi is: [{'id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'name': 'tempest-ServerRescueNegativeTestJSON-2014485163-router', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.181'}], 'enable_snat': True}, 'gw_port_id': 'f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T16:58:23Z', 'revision_number': 4, 'project_id': '4199ca0b18374af7856c19238fc2fea1', 'gw_port': {'id': 'f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6d:5a:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 61, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T16:58:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5', 'name': '', 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1', 'mac_address': 'fa:16:3e:f4:21:a5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'fd331d5b-40b1-4163-8537-7af4e56f1efd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:20Z', 'updated_at': '2021-09-01T16:58:30Z', 'revision_number': 4, 'project_id': '4199ca0b18374af7856c19238fc2fea1', 'subnets': [{'id': 'fd331d5b-40b1-4163-8537-7af4e56f1efd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 16:58:31.632229 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78c60b5c-3d31-47c6-a63e-75bb1348a1b8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5026565c-1ffb-47d7-bede-441247e82e45,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:31.694289 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:31.786512 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Releasing vlan 503 on physical network physnet1 to pool {{(pid=93835) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 16:58:31.786874 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7342797'] for segment, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: from cryptography.utils import int_from_bytes Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: from cryptography.utils import int_from_bytes Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: Traceback (most recent call last): Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: timer() Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: cb(*args, **kw) Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: return func(*args, **kwargs) Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: self._notify() Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: self.callback(batched_events) Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: event.method(event) Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: return f(self, *a, **k) Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._get(url).json() Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: return self.request(url, 'GET', **kwargs) Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 16:58:31.790848 dv-cinder-799668-16-iscsi neutron-server[93835]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 16:58:31.986931 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f5b90583-b150-40fc-aff9-fe536fb724c5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Network 8331b65a-166e-454c-a3c5-ed861dc82dfc is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:58:32.002869 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f5b90583-b150-40fc-aff9-fe536fb724c5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:32.018999 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f5b90583-b150-40fc-aff9-fe536fb724c5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:58:32.023094 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:32.025883 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f5b90583-b150-40fc-aff9-fe536fb724c5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:32.026609 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f5b90583-b150-40fc-aff9-fe536fb724c5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for port, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:32.028981 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:32.031399 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] 10.222.0.67 "DELETE /v2.0/networks/6b2274d5-2da9-45f5-b934-8322fdab0f3f HTTP/1.1" status: 204 len: 168 time: 3.0578542 Sep 01 16:58:32.034776 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5b90583-b150-40fc-aff9-fe536fb724c5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Pushing event updated for resources: {'Port': ['ID=3890e11d-5295-488a-9033-9814bb94bf69,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:32.057738 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50752) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:32.081237 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a827f03a-f203-46bc-b574-d22f6755a408 req-f5721d82-0880-4d09-9dda-cdefcc592cc7 service neutron] 10.222.0.67 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9639211 Sep 01 16:58:32.227859 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f5b90583-b150-40fc-aff9-fe536fb724c5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 4.8605382 Sep 01 16:58:32.250157 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c9a9fe9-3aa2-419e-bd87-b8ef3978d6ab admin admin] Pushing event deleted for resources: {'Network': ['ID=6b2274d5-2da9-45f5-b934-8322fdab0f3f,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:32.253426 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-3726ec20-614f-4c65-9308-4414581823b8 req-4770f623-8b21-44fb-9cdd-89b1da6dc86b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Allocated IP 172.20.0.5 (4af50d67-ae76-48e9-804b-cf2e7dc7f714/9b4a4924-07f0-4c55-a14a-c9f863402ba1/ecc1fde7-837e-4490-b1f8-93b04ddaab48) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:58:32.259864 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-38654d2a-cf9a-4999-802a-8dbb2c2c81b6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93836) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 16:58:32.268290 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-38654d2a-cf9a-4999-802a-8dbb2c2c81b6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0192678 Sep 01 16:58:32.360656 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_v2 [None req-a2dcb911-73ea-4bf0-b094-e31468f6e3da admin admin] Deleting subnet 3d190f80-a93f-4830-8632-342cc44d5338 {{(pid=93835) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 16:58:32.372516 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a2dcb911-73ea-4bf0-b094-e31468f6e3da admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:32.405320 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a827f03a-f203-46bc-b574-d22f6755a408 req-4d08b909-53fb-437e-9a02-baa489e0f8d9 service neutron] 10.222.0.67 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3040316 Sep 01 16:58:32.531312 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 451f37bd-beb9-4944-a58c-21316e8aa987 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:58:32.554686 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a2dcb911-73ea-4bf0-b094-e31468f6e3da admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8197692'] for subnet, precommit_delete_associations {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:32.581436 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-131612fd-35d1-471f-8f76-be8117e5e73f req-8c4ddcbe-63ec-4de9-a783-7edab437ea3a tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 210 time: 0.0927463 Sep 01 16:58:32.590058 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50766) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:32.684890 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a2dcb911-73ea-4bf0-b094-e31468f6e3da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:32.723643 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 451f37bd-beb9-4944-a58c-21316e8aa987 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:58:32.730739 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 451f37bd-beb9-4944-a58c-21316e8aa987 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:32.734119 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:32.824163 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a2dcb911-73ea-4bf0-b094-e31468f6e3da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7342711', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5120114'] for subnet, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:32.837437 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50778) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:32.889444 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a2dcb911-73ea-4bf0-b094-e31468f6e3da admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:32.891923 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-a2dcb911-73ea-4bf0-b094-e31468f6e3da admin admin] 10.222.0.67 "DELETE /v2.0/subnets/3d190f80-a93f-4830-8632-342cc44d5338 HTTP/1.1" status: 204 len: 168 time: 0.8145578 Sep 01 16:58:32.914384 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50780) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:32.922472 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b0903e71-a57e-4942-8ec7-6d1af1e6e2e2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:32.940267 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:33.002439 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port 451f37bd-beb9-4944-a58c-21316e8aa987, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=451f37bd-beb9-4944-a58c-21316e8aa987,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:58:33.021133 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:33.022364 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:58:33.217559 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=451f37bd-beb9-4944-a58c-21316e8aa987,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:33.254774 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:58:33.275648 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:33.286470 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:33.345691 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dcb911-73ea-4bf0-b094-e31468f6e3da admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3d190f80-a93f-4830-8632-342cc44d5338,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:33.381682 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1acb7ce5-f850-4381-a5f5-e3f01656c93e req-581312b2-b8e8-43ee-870f-efa88ec8b597 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:33.383299 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1acb7ce5-f850-4381-a5f5-e3f01656c93e req-581312b2-b8e8-43ee-870f-efa88ec8b597 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 931 time: 0.3886099 Sep 01 16:58:33.449054 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-6728b437-46bf-4520-a70e-305784d520fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:33.554398 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:33.609100 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Request body: {'port': {'device_id': '1bb80ba2-8b84-49d5-b868-889e3b7b8630', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:33.649955 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5,segment=NetworkSegment(9dfcf32c-db95-455a-ac7a-283312e9c7a0),segment_id=9dfcf32c-db95-455a-ac7a-283312e9c7a0)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:58:33.656561 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:33.690237 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1acb7ce5-f850-4381-a5f5-e3f01656c93e req-ed57edd4-3a82-44a1-8522-470dc7644e80 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2578428 Sep 01 16:58:33.774464 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:33.805522 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-69032538-c525-4e15-8903-b0026ef5549b admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:33.908762 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3726ec20-614f-4c65-9308-4414581823b8 req-4770f623-8b21-44fb-9cdd-89b1da6dc86b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:33.962500 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3726ec20-614f-4c65-9308-4414581823b8 req-4770f623-8b21-44fb-9cdd-89b1da6dc86b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:33.977686 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d80fde67-e1c6-4c36-9c83-a684ef020d42 req-66c492f6-ca28-4463-8a7f-917f803037be tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 210 time: 0.1545849 Sep 01 16:58:34.029903 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:34.042249 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50804) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:34.099799 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-43acf0f8-f9fd-4fe9-8b74-a7f873962d52 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1156409468', 'description': 'tempest-description--854930460'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:34.140398 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b0903e71-a57e-4942-8ec7-6d1af1e6e2e2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:34.265833 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-6728b437-46bf-4520-a70e-305784d520fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:34.288451 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3726ec20-614f-4c65-9308-4414581823b8 req-4770f623-8b21-44fb-9cdd-89b1da6dc86b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Network 4af50d67-ae76-48e9-804b-cf2e7dc7f714 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:58:34.328884 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-3726ec20-614f-4c65-9308-4414581823b8 req-4770f623-8b21-44fb-9cdd-89b1da6dc86b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:34.339342 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 451f37bd-beb9-4944-a58c-21316e8aa987 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:58:34.358979 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-3726ec20-614f-4c65-9308-4414581823b8 req-4770f623-8b21-44fb-9cdd-89b1da6dc86b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:58:34.374496 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-6728b437-46bf-4520-a70e-305784d520fa admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['28f1402b-614b-4d64-8877-fc91e3ab0ed5']}} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:34.462583 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4770f623-8b21-44fb-9cdd-89b1da6dc86b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Pushing event updated for resources: {'Port': ['ID=ecc1fde7-837e-4490-b1f8-93b04ddaab48,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:34.486586 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 451f37bd-beb9-4944-a58c-21316e8aa987 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:34.490255 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:34.490683 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-6728b437-46bf-4520-a70e-305784d520fa admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bde3412a-46b2-40ca-999f-16c1a142f381') {'for_net_delete': True} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:34.491253 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-6728b437-46bf-4520-a70e-305784d520fa admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bde3412a-46b2-40ca-999f-16c1a142f381') {} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:34.521455 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b0903e71-a57e-4942-8ec7-6d1af1e6e2e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:34.552149 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-6728b437-46bf-4520-a70e-305784d520fa admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8197639'] for segment, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:34.615895 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Sync routers for ids ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 16:58:34.632524 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3726ec20-614f-4c65-9308-4414581823b8 req-4770f623-8b21-44fb-9cdd-89b1da6dc86b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:34.636233 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3726ec20-614f-4c65-9308-4414581823b8 req-4770f623-8b21-44fb-9cdd-89b1da6dc86b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:34.680568 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-6728b437-46bf-4520-a70e-305784d520fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6728b437-46bf-4520-a70e-305784d520fa admin admin] Releasing vlan 511 on physical network physnet1 to pool {{(pid=93835) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-6728b437-46bf-4520-a70e-305784d520fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7342797'] for segment, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: Traceback (most recent call last): Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: timer() Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: cb(*args, **kw) Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: return func(*args, **kwargs) Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: self._notify() Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: self.callback(batched_events) Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: event.method(event) Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: return f(self, *a, **k) Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._get(url).json() Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: return self.request(url, 'GET', **kwargs) Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 16:58:34.717332 dv-cinder-799668-16-iscsi neutron-server[93835]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 16:58:34.780989 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:58:34.848747 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Routers {'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:58:34.849742 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:58:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:34.876065 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-6728b437-46bf-4520-a70e-305784d520fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:34.881033 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-6728b437-46bf-4520-a70e-305784d520fa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:34.890385 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-6728b437-46bf-4520-a70e-305784d520fa admin admin] 10.222.0.67 "DELETE /v2.0/networks/28f1402b-614b-4d64-8877-fc91e3ab0ed5 HTTP/1.1" status: 204 len: 168 time: 1.9729297 Sep 01 16:58:34.928981 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6728b437-46bf-4520-a70e-305784d520fa admin admin] Pushing event deleted for resources: {'Network': ['ID=28f1402b-614b-4d64-8877-fc91e3ab0ed5,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:35.010169 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-b0903e71-a57e-4942-8ec7-6d1af1e6e2e2 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=989d32c870e74c55af98eb2508e7af71&name=default HTTP/1.1" status: 200 len: 2979 time: 2.1681759 Sep 01 16:58:35.010721 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50830) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:35.141900 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:35.142550 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:35.211453 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f1d8e90e-166c-4b8d-8eb0-77f39af1e1df admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:35.236621 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Set router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:58:35.252846 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50836) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:35.279120 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-69032538-c525-4e15-8903-b0026ef5549b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:35.303868 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-f5a6994d-1bec-41c0-aeed-d2b291e585bd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:35.309517 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-f5a6994d-1bec-41c0-aeed-d2b291e585bd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/networks?id=63606bb0-66bd-46d6-ba6c-55c6da830865 HTTP/1.1" status: 200 len: 819 time: 0.7776909 Sep 01 16:58:35.326632 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-69032538-c525-4e15-8903-b0026ef5549b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:35.333475 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-7e6775c5-1ea6-44e4-a52b-7dcf6ddbed16 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=bd3063d078734b61a0fb8e89f35c5a52&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0786746 Sep 01 16:58:35.339578 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f1d8e90e-166c-4b8d-8eb0-77f39af1e1df admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:35.344769 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-4770f623-8b21-44fb-9cdd-89b1da6dc86b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 5.7802837 Sep 01 16:58:35.350107 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50840) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:35.428704 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0903e71-a57e-4942-8ec7-6d1af1e6e2e2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ead70a16-b6f0-46dd-8f0c-49977d6ada81,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:35.438389 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fec14f71-d5ae-41d9-af35-0f7d3b8a378e req-bf90ab69-9cf3-46c5-9b37-61d9f9cba9e5 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:35.439939 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fec14f71-d5ae-41d9-af35-0f7d3b8a378e req-bf90ab69-9cf3-46c5-9b37-61d9f9cba9e5 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 931 time: 1.3187745 Sep 01 16:58:35.470815 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69032538-c525-4e15-8903-b0026ef5549b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=91f9989a-7f06-4f47-b473-ddc99bb7e677,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:35.490289 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-42ad900c-2800-44d2-812d-5f539e32de3c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/quotas/4199ca0b18374af7856c19238fc2fea1 HTTP/1.1" status: 200 len: 375 time: 0.1605825 Sep 01 16:58:35.497372 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-43acf0f8-f9fd-4fe9-8b74-a7f873962d52 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:35.508698 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-69032538-c525-4e15-8903-b0026ef5549b admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=c7da83ecb3f749a3b61c5627ae46f4ed&name=default HTTP/1.1" status: 200 len: 2979 time: 2.9167635 Sep 01 16:58:35.513425 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50844) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:35.546555 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3ac05848-0ca9-410a-bd9e-f195c8b5cec4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:35.604106 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3ac05848-0ca9-410a-bd9e-f195c8b5cec4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:35.614066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Request body: {'port': {'device_id': 'e18ee49e-3bbd-4cca-ae7e-0185ef0d225c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:35.653575 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f1d8e90e-166c-4b8d-8eb0-77f39af1e1df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:35.665627 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f1d8e90e-166c-4b8d-8eb0-77f39af1e1df admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:35.666791 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-f1d8e90e-166c-4b8d-8eb0-77f39af1e1df admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/ead70a16-b6f0-46dd-8f0c-49977d6ada81 HTTP/1.1" status: 204 len: 168 time: 0.6549239 Sep 01 16:58:35.674214 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-6cbe63cd-4d03-40f9-9c1e-138960e197a0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=4199ca0b18374af7856c19238fc2fea1&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1738029 Sep 01 16:58:35.684413 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fec14f71-d5ae-41d9-af35-0f7d3b8a378e req-ff16b82e-e1f5-45ac-a913-49a83dd5c036 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1998744 Sep 01 16:58:35.747660 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1d8e90e-166c-4b8d-8eb0-77f39af1e1df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ead70a16-b6f0-46dd-8f0c-49977d6ada81,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:35.822233 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e44222c5-c740-40b8-b170-79a0a9a0981d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:35.826329 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:35.855055 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3ac05848-0ca9-410a-bd9e-f195c8b5cec4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:35.858795 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:27Z', 'revision_number': 2, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:35.860960 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3ac05848-0ca9-410a-bd9e-f195c8b5cec4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:35.863266 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-3ac05848-0ca9-410a-bd9e-f195c8b5cec4 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/6f373fe9-b615-426b-b5b6-0d0d1afcf53f HTTP/1.1" status: 204 len: 168 time: 0.4992192 Sep 01 16:58:35.895390 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac05848-0ca9-410a-bd9e-f195c8b5cec4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f373fe9-b615-426b-b5b6-0d0d1afcf53f,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:35.923944 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Checking router: e95cfaf6-7dbf-4e42-af63-5c1ea40c693e for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 16:58:35.925913 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Updating router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e port 99045034-e927-44d2-85d3-7df40bb8cb9b binding host dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 16:58:36.001408 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:36.258405 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.69', 52068) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:36.366282 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.notifiers.nova [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3890e11d-5295-488a-9033-9814bb94bf69 {{(pid=93836) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 16:58:36.386808 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e44222c5-c740-40b8-b170-79a0a9a0981d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:36.442624 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:36.545730 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-c1cad587-6bb8-4071-a3fd-728faab9caf6 service neutron] 10.222.0.67 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8438816 Sep 01 16:58:36.554294 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.provisioning_blocks [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Transition to ACTIVE for port object 3890e11d-5295-488a-9033-9814bb94bf69 will not be triggered until provisioned by entity L2. {{(pid=93836) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:58:36.564458 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50862) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:36.640967 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4c2f31-c3b9-466b-8993-0d8f58e5d65e req-b4eda83e-c75f-4237-8ba4-82bd15f8c287 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:36.662456 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3b4c2f31-c3b9-466b-8993-0d8f58e5d65e req-b4eda83e-c75f-4237-8ba4-82bd15f8c287 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 931 time: 0.4664838 Sep 01 16:58:36.665273 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:36.670871 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-43acf0f8-f9fd-4fe9-8b74-a7f873962d52 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:36.769851 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-43acf0f8-f9fd-4fe9-8b74-a7f873962d52 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:36.797057 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Notify callbacks [] for port, precommit_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:36.812247 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Transition to ACTIVE for port object 99045034-e927-44d2-85d3-7df40bb8cb9b will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:58:36.822123 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:36.846142 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43acf0f8-f9fd-4fe9-8b74-a7f873962d52 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5fc77e84-de9d-44e5-b947-11c478e5af40,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:36.921983 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9da186d4-2e34-4ccf-a895-753a831dfed5 None None] Pushing event updated for resources: {'Port': ['ID=99045034-e927-44d2-85d3-7df40bb8cb9b,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:36.955961 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a827f03a-f203-46bc-b574-d22f6755a408 req-b89496ed-e6d7-43e3-a9da-9790be00eb50 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:36.958921 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a827f03a-f203-46bc-b574-d22f6755a408 req-b89496ed-e6d7-43e3-a9da-9790be00eb50 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.69 "GET /v2.0/networks?id=63606bb0-66bd-46d6-ba6c-55c6da830865 HTTP/1.1" status: 200 len: 819 time: 0.6995492 Sep 01 16:58:37.041811 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-f28cde19-6d34-4d43-b667-d369a7f702c9 service neutron] 10.222.0.67 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4753017 Sep 01 16:58:37.076890 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Attempting to bind port 99045034-e927-44d2-85d3-7df40bb8cb9b on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:58:37.077267 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Attempting to bind port 99045034-e927-44d2-85d3-7df40bb8cb9b by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:58:37.079141 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Attempting to bind port 99045034-e927-44d2-85d3-7df40bb8cb9b on network 2f7bfe5e-0012-467f-ad7f-aea2467233ac {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:37.085736 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-43acf0f8-f9fd-4fe9-8b74-a7f873962d52 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:37.091350 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 58, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:58:37.091897 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Checking segment: {'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:37.092382 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:37.092842 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-43acf0f8-f9fd-4fe9-8b74-a7f873962d52 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 3.0398631 Sep 01 16:58:37.098145 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50880) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:37.104813 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Bound using segment: {'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:58:37.105933 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Bound port: 99045034-e927-44d2-85d3-7df40bb8cb9b, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:58:37.114258 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:37.115101 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-647290e5-2fc1-4bf6-a905-525c1384caf7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Request body: {'security_group_rule': {'security_group_id': '5fc77e84-de9d-44e5-b947-11c478e5af40', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:37.200374 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-dc74bfe9-979c-4d50-a330-b6de73cdb363 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=2339fbb956884b75975749e714a7e63c&name=default HTTP/1.1" status: 200 len: 2975 time: 0.6163108 Sep 01 16:58:37.207528 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Pushing event updated for resources: {'Port': ['ID=3890e11d-5295-488a-9033-9814bb94bf69,revision_number=2']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:37.218892 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3b4c2f31-c3b9-466b-8993-0d8f58e5d65e req-96a2d342-41e4-4729-b510-df31f8291fc5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5557084 Sep 01 16:58:37.221751 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50884) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:37.347554 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-647290e5-2fc1-4bf6-a905-525c1384caf7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:37.355044 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] For port 99045034-e927-44d2-85d3-7df40bb8cb9b, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:58:37.358951 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] For port 99045034-e927-44d2-85d3-7df40bb8cb9b, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=99045034-e927-44d2-85d3-7df40bb8cb9b,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:58:37.360962 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e44222c5-c740-40b8-b170-79a0a9a0981d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:37.363834 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:37.375414 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e44222c5-c740-40b8-b170-79a0a9a0981d admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:37.379291 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-e44222c5-c740-40b8-b170-79a0a9a0981d admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/91f9989a-7f06-4f47-b473-ddc99bb7e677 HTTP/1.1" status: 204 len: 168 time: 1.8491957 Sep 01 16:58:37.537372 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e44222c5-c740-40b8-b170-79a0a9a0981d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=91f9989a-7f06-4f47-b473-ddc99bb7e677,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:37.639701 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Routers {'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:58:37.640357 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:58:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:37.680367 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f5c24ee4-cc37-40d7-a064-c586f0709e5f req-02654b19-8a4c-4d7e-9474-4156d5e8e848 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 210 time: 0.1254439 Sep 01 16:58:37.823070 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-a827f03a-f203-46bc-b574-d22f6755a408 req-590050be-e4d6-4a1a-9ac4-c67f2f99b369 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Request body: {'port': {'device_id': '84bd0410-fb41-4744-970f-c2402a7faf77', 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865', 'admin_state_up': True, 'tenant_id': '4199ca0b18374af7856c19238fc2fea1'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:37.839192 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.managers [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Attempting to bind port 3890e11d-5295-488a-9033-9814bb94bf69 on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93836) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:58:37.844623 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.managers [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Attempting to bind port 3890e11d-5295-488a-9033-9814bb94bf69 by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'}] {{(pid=93836) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:58:37.845079 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Attempting to bind port 3890e11d-5295-488a-9033-9814bb94bf69 on network 8331b65a-166e-454c-a3c5-ed861dc82dfc {{(pid=93836) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:37.903073 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Port 3890e11d-5295-488a-9033-9814bb94bf69 on network 8331b65a-166e-454c-a3c5-ed861dc82dfc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93836) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 16:58:37.903555 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Attempting to bind port 3890e11d-5295-488a-9033-9814bb94bf69 on network 8331b65a-166e-454c-a3c5-ed861dc82dfc {{(pid=93836) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:37.981259 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 58, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93836) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:58:37.981744 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Checking segment: {'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93836) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:37.982360 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Bound using segment: {'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'} {{(pid=93836) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:58:37.982888 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.managers [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Bound port: 3890e11d-5295-488a-9033-9814bb94bf69, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'}}] {{(pid=93836) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:58:37.983299 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:38.016233 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-647290e5-2fc1-4bf6-a905-525c1384caf7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:38.036329 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-647290e5-2fc1-4bf6-a905-525c1384caf7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:38.092802 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ecc1fde7-837e-4490-b1f8-93b04ddaab48 {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 16:58:38.102732 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-647290e5-2fc1-4bf6-a905-525c1384caf7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:38.113634 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-647290e5-2fc1-4bf6-a905-525c1384caf7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.0122759 Sep 01 16:58:38.117277 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50914) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:38.118712 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9da186d4-2e34-4ccf-a895-753a831dfed5 None None] Pushing event updated for resources: {'Port': ['ID=99045034-e927-44d2-85d3-7df40bb8cb9b,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:38.131059 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-647290e5-2fc1-4bf6-a905-525c1384caf7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ec56d8cc-c4f3-4e2b-8096-e507f28b01a7,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:38.140558 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:38.161740 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-ef191dc4-e79b-4d04-9ac3-0ecff7372767 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Request body: {'security_group_rule': {'security_group_id': '5fc77e84-de9d-44e5-b947-11c478e5af40', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:38.210588 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] Set router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:58:38.219405 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] For port 3890e11d-5295-488a-9033-9814bb94bf69, host hv-cinder-79966, cleared binding levels {{(pid=93836) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:58:38.224664 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] For port 3890e11d-5295-488a-9033-9814bb94bf69, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=3890e11d-5295-488a-9033-9814bb94bf69,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93836) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:58:38.237369 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50920) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:38.250140 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:38.312708 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ef191dc4-e79b-4d04-9ac3-0ecff7372767 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:38.333951 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0443ccea-7078-4156-8db3-7d78017a5cf8 req-c9ae9622-a5e1-4716-882a-70c4a83f0d3e tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:38.335592 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0443ccea-7078-4156-8db3-7d78017a5cf8 req-c9ae9622-a5e1-4716-882a-70c4a83f0d3e tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 931 time: 0.8458383 Sep 01 16:58:38.394938 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Transition to ACTIVE for port object ecc1fde7-837e-4490-b1f8-93b04ddaab48 will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:58:38.429541 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 99045034-e927-44d2-85d3-7df40bb8cb9b up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:58:38.439237 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:38.472574 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2c5ffdff-369e-4f2f-94f4-1460a491bc17 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:38.522188 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:38.523539 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for port, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:38.527772 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] 10.222.0.69 "PUT /v2.0/ports/3890e11d-5295-488a-9033-9814bb94bf69 HTTP/1.1" status: 200 len: 1093 time: 5.6175535 Sep 01 16:58:38.528868 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0e1714c5-4438-4dfc-901c-f8ea56738bec admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:38.591603 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1bb80ba2-8b84-49d5-b868-889e3b7b8630', 'tag': '3890e11d-5295-488a-9033-9814bb94bf69'}] {{(pid=93836) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 16:58:38.687400 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 99045034-e927-44d2-85d3-7df40bb8cb9b completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:58:38.697567 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a827f03a-f203-46bc-b574-d22f6755a408 req-590050be-e4d6-4a1a-9ac4-c67f2f99b369 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Made reservation on behalf of 4199ca0b18374af7856c19238fc2fea1 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:38.708416 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a827f03a-f203-46bc-b574-d22f6755a408 req-590050be-e4d6-4a1a-9ac4-c67f2f99b369 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:38.722812 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 99045034-e927-44d2-85d3-7df40bb8cb9b triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:38.723188 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:38.728061 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Pushing event updated for resources: {'Port': ['ID=ecc1fde7-837e-4490-b1f8-93b04ddaab48,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:38.769270 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ef191dc4-e79b-4d04-9ac3-0ecff7372767 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:38.797421 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ef191dc4-e79b-4d04-9ac3-0ecff7372767 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:39.011125 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0443ccea-7078-4156-8db3-7d78017a5cf8 req-45859b3c-59f9-42dd-9dbf-068f21b598df tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6319323 Sep 01 16:58:39.059625 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-a827f03a-f203-46bc-b574-d22f6755a408 req-590050be-e4d6-4a1a-9ac4-c67f2f99b369 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Allocated IP 172.20.0.9 (63606bb0-66bd-46d6-ba6c-55c6da830865/fd331d5b-40b1-4163-8537-7af4e56f1efd/e3d13334-c7d0-4f40-a25b-5c27c5f90c65) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:58:39.165303 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2c5ffdff-369e-4f2f-94f4-1460a491bc17 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:39.234672 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2c5ffdff-369e-4f2f-94f4-1460a491bc17 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:39.338940 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6a5d558-2ff7-4723-b3cd-f0cf6c8b1989 service neutron] Pushing event updated for resources: {'Port': ['ID=3890e11d-5295-488a-9033-9814bb94bf69,revision_number=3']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:39.361427 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0e1714c5-4438-4dfc-901c-f8ea56738bec admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:39.362745 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:37Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:58:39.369070 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}60a7e58791dd3a103db7a0d35103b09d0a4cb2c205e1177c181e158a6fe3866f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-496c01e4-a58d-4e9e-8187-211faab46a88" -d '{"events": [{"name": "network-changed", "server_uuid": "1bb80ba2-8b84-49d5-b868-889e3b7b8630", "tag": "3890e11d-5295-488a-9033-9814bb94bf69"}]}' {{(pid=93836) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 16:58:39.408924 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a827f03a-f203-46bc-b574-d22f6755a408 req-590050be-e4d6-4a1a-9ac4-c67f2f99b369 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:39.417813 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:39.423951 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e86ee7b-c114-4f03-be11-4b6878cfb7df None None] The sync data for ids ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'] in dv-cinder-799668-16-iscsi is: [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:37Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 16:58:39.495837 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a827f03a-f203-46bc-b574-d22f6755a408 req-590050be-e4d6-4a1a-9ac4-c67f2f99b369 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:39.513267 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port 99045034-e927-44d2-85d3-7df40bb8cb9b, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=99045034-e927-44d2-85d3-7df40bb8cb9b,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:58:39.523104 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:39.545773 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1feacfcf-72f3-4ecc-b287-aaf927810b67 req-61fb0bf7-4722-4953-9305-fc49a44246a3 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:39.547586 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1feacfcf-72f3-4ecc-b287-aaf927810b67 req-61fb0bf7-4722-4953-9305-fc49a44246a3 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 943 time: 1.0712819 Sep 01 16:58:39.551087 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-928577a1-55a0-45b4-b075-d59f0ff4c9bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:39.558545 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-928577a1-55a0-45b4-b075-d59f0ff4c9bf service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7032b30e75954f8da9ad2cb64f1f5ad1&device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 1096 time: 0.7548525 Sep 01 16:58:39.588280 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3844737c-cfa3-4055-baee-7e4c8dc98b9d req-1c6afb8c-5bb4-4993-b548-e71346ade680 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 210 time: 0.2663517 Sep 01 16:58:39.659458 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=99045034-e927-44d2-85d3-7df40bb8cb9b,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:39.698710 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-2c5ffdff-369e-4f2f-94f4-1460a491bc17 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=549fa6335da14bdf8840d999a892dacc&name=default HTTP/1.1" status: 200 len: 2979 time: 1.4440145 Sep 01 16:58:39.705224 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef191dc4-e79b-4d04-9ac3-0ecff7372767 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3adf3335-5bb0-47ab-8cda-c79d0c540ddd,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:39.707949 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 50958) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:39.726534 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c5ffdff-369e-4f2f-94f4-1460a491bc17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=755fd187-1196-4068-99a5-d3b92129406a,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:39.810805 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1feacfcf-72f3-4ecc-b287-aaf927810b67 req-43e9c2ed-c951-4645-aecb-6474bb42380d tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2294691 Sep 01 16:58:39.833308 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0e1714c5-4438-4dfc-901c-f8ea56738bec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:39.840399 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0e1714c5-4438-4dfc-901c-f8ea56738bec admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:39.840399 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-0e1714c5-4438-4dfc-901c-f8ea56738bec admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/1b503082-1605-424c-b6ef-da7a6695486a HTTP/1.1" status: 204 len: 168 time: 2.6155808 Sep 01 16:58:39.858330 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e1714c5-4438-4dfc-901c-f8ea56738bec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b503082-1605-424c-b6ef-da7a6695486a,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:39.917759 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5eeb8ffe-a466-4c4f-819e-d1ca43484c67 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:39.945132 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5eeb8ffe-a466-4c4f-819e-d1ca43484c67 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:39.980342 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ef191dc4-e79b-4d04-9ac3-0ecff7372767 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:39.982245 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-ef191dc4-e79b-4d04-9ac3-0ecff7372767 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.8461185 Sep 01 16:58:39.984382 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a827f03a-f203-46bc-b574-d22f6755a408 req-590050be-e4d6-4a1a-9ac4-c67f2f99b369 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Network 63606bb0-66bd-46d6-ba6c-55c6da830865 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:58:39.985833 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 50970) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:39.990402 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Request body: {'floatingip': {'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:40.004219 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-a827f03a-f203-46bc-b574-d22f6755a408 req-590050be-e4d6-4a1a-9ac4-c67f2f99b369 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:40.011097 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-a827f03a-f203-46bc-b574-d22f6755a408 req-590050be-e4d6-4a1a-9ac4-c67f2f99b369 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:58:40.067142 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for floatingip, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:40.096088 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Attempting to bind port ecc1fde7-837e-4490-b1f8-93b04ddaab48 on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:58:40.103475 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Attempting to bind port ecc1fde7-837e-4490-b1f8-93b04ddaab48 by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': '2785b39f-9a72-4d03-a737-382dced1c97a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 532, 'network_id': '4af50d67-ae76-48e9-804b-cf2e7dc7f714'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:58:40.105109 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Attempting to bind port ecc1fde7-837e-4490-b1f8-93b04ddaab48 on network 4af50d67-ae76-48e9-804b-cf2e7dc7f714 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:40.117041 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 16:58:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-394fb48e-c867-499e-b9cc-b9b62fcb619a x-openstack-request-id: req-394fb48e-c867-499e-b9cc-b9b62fcb619a {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 16:58:40.117374 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1bb80ba2-8b84-49d5-b868-889e3b7b8630", "tag": "3890e11d-5295-488a-9033-9814bb94bf69", "status": "completed", "code": 200}]} {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 16:58:40.117651 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-394fb48e-c867-499e-b9cc-b9b62fcb619a {{(pid=93836) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 16:58:40.118157 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1bb80ba2-8b84-49d5-b868-889e3b7b8630', 'tag': '3890e11d-5295-488a-9033-9814bb94bf69', 'status': 'completed', 'code': 200} Sep 01 16:58:40.167043 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a827f03a-f203-46bc-b574-d22f6755a408 req-590050be-e4d6-4a1a-9ac4-c67f2f99b369 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:40.167822 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a827f03a-f203-46bc-b574-d22f6755a408 req-590050be-e4d6-4a1a-9ac4-c67f2f99b369 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:40.178541 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-590050be-e4d6-4a1a-9ac4-c67f2f99b369 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Pushing event updated for resources: {'Port': ['ID=e3d13334-c7d0-4f40-a25b-5c27c5f90c65,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:40.187293 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Port ecc1fde7-837e-4490-b1f8-93b04ddaab48 on network 4af50d67-ae76-48e9-804b-cf2e7dc7f714 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 16:58:40.188002 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Attempting to bind port ecc1fde7-837e-4490-b1f8-93b04ddaab48 on network 4af50d67-ae76-48e9-804b-cf2e7dc7f714 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:40.197167 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 58, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:58:40.197659 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Checking segment: {'id': '2785b39f-9a72-4d03-a737-382dced1c97a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 532, 'network_id': '4af50d67-ae76-48e9-804b-cf2e7dc7f714'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:40.198726 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Bound using segment: {'id': '2785b39f-9a72-4d03-a737-382dced1c97a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 532, 'network_id': '4af50d67-ae76-48e9-804b-cf2e7dc7f714'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:58:40.200620 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Bound port: ecc1fde7-837e-4490-b1f8-93b04ddaab48, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2785b39f-9a72-4d03-a737-382dced1c97a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 532, 'network_id': '4af50d67-ae76-48e9-804b-cf2e7dc7f714'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:58:40.201245 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:40.230076 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a827f03a-f203-46bc-b574-d22f6755a408 req-590050be-e4d6-4a1a-9ac4-c67f2f99b369 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.4100373 Sep 01 16:58:40.312525 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Request body: {'port': {'device_id': '84bd0410-fb41-4744-970f-c2402a7faf77', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:40.327573 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5eeb8ffe-a466-4c4f-819e-d1ca43484c67 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:40.335365 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5eeb8ffe-a466-4c4f-819e-d1ca43484c67 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:40.336527 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-5eeb8ffe-a466-4c4f-819e-d1ca43484c67 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/755fd187-1196-4068-99a5-d3b92129406a HTTP/1.1" status: 204 len: 168 time: 0.5816064 Sep 01 16:58:40.391390 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 99045034-e927-44d2-85d3-7df40bb8cb9b up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:58:40.478384 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eeb8ffe-a466-4c4f-819e-d1ca43484c67 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=755fd187-1196-4068-99a5-d3b92129406a,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:40.576189 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 99045034-e927-44d2-85d3-7df40bb8cb9b triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:40.576845 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:40.636397 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-8d5a5dbf-833c-4565-8a7b-b451137161ff service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=3890e11d-5295-488a-9033-9814bb94bf69 HTTP/1.1" status: 200 len: 217 time: 0.3155873 Sep 01 16:58:40.729548 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:40.751180 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] For port ecc1fde7-837e-4490-b1f8-93b04ddaab48, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:58:40.915267 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] For port ecc1fde7-837e-4490-b1f8-93b04ddaab48, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=ecc1fde7-837e-4490-b1f8-93b04ddaab48,segment=NetworkSegment(2785b39f-9a72-4d03-a737-382dced1c97a),segment_id=2785b39f-9a72-4d03-a737-382dced1c97a)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:58:40.995798 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-bc3d9e74-aecb-40ce-a887-a74d3f6260fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:41.001348 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-bc3d9e74-aecb-40ce-a887-a74d3f6260fe service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd025a14-8839-4451-a03e-bc7daeb612d0 HTTP/1.1" status: 200 len: 854 time: 0.2356009 Sep 01 16:58:41.001981 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:41.036812 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ef1ed0da-cf17-4511-9e35-13a3011a871c req-6ac6fd52-90f6-402e-9022-bf920f66d38e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 210 time: 0.2616031 Sep 01 16:58:41.061379 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:41.061379 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:41.066287 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] 10.222.0.69 "PUT /v2.0/ports/ecc1fde7-837e-4490-b1f8-93b04ddaab48 HTTP/1.1" status: 200 len: 1093 time: 5.4611411 Sep 01 16:58:41.086153 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e18ee49e-3bbd-4cca-ae7e-0185ef0d225c', 'tag': 'ecc1fde7-837e-4490-b1f8-93b04ddaab48'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 16:58:41.116224 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cde278d-041f-4adc-b5df-51390e163a77 req-df6d0b45-fbd1-44a7-8f4f-c97881bf6998 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:41.119084 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0cde278d-041f-4adc-b5df-51390e163a77 req-df6d0b45-fbd1-44a7-8f4f-c97881bf6998 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 943 time: 0.8772955 Sep 01 16:58:41.314771 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-fa6f733b-45a5-4441-b4e9-f4d05b79c32d service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8331b65a-166e-454c-a3c5-ed861dc82dfc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0807519 Sep 01 16:58:41.347998 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0cde278d-041f-4adc-b5df-51390e163a77 req-507a36a8-6c75-4100-8f06-f76ff18966aa tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2200267 Sep 01 16:58:41.379742 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd957c4-7600-4032-b672-034cda6cbe56 req-c2715fd8-5cc9-46cc-bbf2-3c5b0adc7bad tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:41.388434 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0cd957c4-7600-4032-b672-034cda6cbe56 req-c2715fd8-5cc9-46cc-bbf2-3c5b0adc7bad tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 943 time: 0.2267022 Sep 01 16:58:41.392052 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:41.471123 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-13cd6372-1754-4155-9477-cfd458627d39 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:41.472649 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-13cd6372-1754-4155-9477-cfd458627d39 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.69 "GET /v2.0/networks?id=63606bb0-66bd-46d6-ba6c-55c6da830865 HTTP/1.1" status: 200 len: 819 time: 0.1433549 Sep 01 16:58:41.501742 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Allocated IP 172.27.1.60 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/016c7291-49f2-4c8d-ad7e-c4b7f9a9bba2) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:58:41.510280 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40c23d9a-95a9-48cc-a568-ff3b91135fda service neutron] Pushing event updated for resources: {'Port': ['ID=ecc1fde7-837e-4490-b1f8-93b04ddaab48,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:41.617896 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:41.702857 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:41.758081 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:58:41.765034 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:41.768375 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:58:41.786837 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e3d13334-c7d0-4f40-a25b-5c27c5f90c65 {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 16:58:41.787787 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0cd957c4-7600-4032-b672-034cda6cbe56 req-d637d629-aee1-4c63-bf3f-b5f26a5634ba tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3981133 Sep 01 16:58:41.807602 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:41.820909 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event updated for resources: {'Port': ['ID=016c7291-49f2-4c8d-ad7e-c4b7f9a9bba2,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:41.848163 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Transition to ACTIVE for port object e3d13334-c7d0-4f40-a25b-5c27c5f90c65 will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:58:41.852032 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f13b3082-8086-4c3b-9180-d34b453c320f" -d '{"events": [{"name": "network-changed", "server_uuid": "e18ee49e-3bbd-4cca-ae7e-0185ef0d225c", "tag": "ecc1fde7-837e-4490-b1f8-93b04ddaab48"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 16:58:41.856124 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:41.924128 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Pushing event updated for resources: {'Port': ['ID=e3d13334-c7d0-4f40-a25b-5c27c5f90c65,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:42.022516 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Attempting to bind port e3d13334-c7d0-4f40-a25b-5c27c5f90c65 on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:58:42.022957 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Attempting to bind port e3d13334-c7d0-4f40-a25b-5c27c5f90c65 by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': '9dfcf32c-db95-455a-ac7a-283312e9c7a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:58:42.023367 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Attempting to bind port e3d13334-c7d0-4f40-a25b-5c27c5f90c65 on network 63606bb0-66bd-46d6-ba6c-55c6da830865 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:42.029626 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Port e3d13334-c7d0-4f40-a25b-5c27c5f90c65 on network 63606bb0-66bd-46d6-ba6c-55c6da830865 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 16:58:42.030036 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Attempting to bind port e3d13334-c7d0-4f40-a25b-5c27c5f90c65 on network 63606bb0-66bd-46d6-ba6c-55c6da830865 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:42.042332 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-603318cf-2b13-4b8d-a15d-3ef639c25e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Request body: {'port': {'device_id': '891d0bc6-0f97-45d5-a4d2-d329fbe22fd6', 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865', 'admin_state_up': True, 'tenant_id': '4199ca0b18374af7856c19238fc2fea1'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:42.049145 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 58, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:58:42.049567 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Checking segment: {'id': '9dfcf32c-db95-455a-ac7a-283312e9c7a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:42.050291 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Bound using segment: {'id': '9dfcf32c-db95-455a-ac7a-283312e9c7a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:58:42.051008 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Bound port: e3d13334-c7d0-4f40-a25b-5c27c5f90c65, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9dfcf32c-db95-455a-ac7a-283312e9c7a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:58:42.055255 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:42.158605 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.69', 52079) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:42.233438 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:42.389228 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-24d9d242-d3ac-4221-acd9-a112fb57edbf req-8908316f-b686-4057-9aa0-a9a76aa9d799 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 210 time: 0.1293590 Sep 01 16:58:42.465096 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3726ec20-614f-4c65-9308-4414581823b8 req-da95496e-bf3a-4768-ba7b-30783bc1e972 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:42.466985 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-da95496e-bf3a-4768-ba7b-30783bc1e972 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=76cfc4ed03034fdc9e2ce4a3580959f7&device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 1096 time: 0.3074975 Sep 01 16:58:42.496809 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-d1377bc5-6d8d-4324-907c-57e03c584e03 service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4163926 Sep 01 16:58:42.497573 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:42.553620 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] For port e3d13334-c7d0-4f40-a25b-5c27c5f90c65, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:58:42.562085 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-603318cf-2b13-4b8d-a15d-3ef639c25e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Made reservation on behalf of 4199ca0b18374af7856c19238fc2fea1 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:42.566281 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-603318cf-2b13-4b8d-a15d-3ef639c25e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:42.687778 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f22bd0b1-88b2-4d05-80c4-9151797267eb req-f05404ee-f70f-4d8b-8f2a-33bda371f5ef service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1288447 Sep 01 16:58:42.829328 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-a61a3224-1f28-4b53-9f19-46f454ffe974 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ecc1fde7-837e-4490-b1f8-93b04ddaab48 HTTP/1.1" status: 200 len: 217 time: 0.2718432 Sep 01 16:58:42.831585 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 16:58:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-632a35b5-d7e4-49dc-96b6-aa73d0b460bb x-openstack-request-id: req-632a35b5-d7e4-49dc-96b6-aa73d0b460bb {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 16:58:42.831938 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e18ee49e-3bbd-4cca-ae7e-0185ef0d225c", "tag": "ecc1fde7-837e-4490-b1f8-93b04ddaab48", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 16:58:42.832257 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-632a35b5-d7e4-49dc-96b6-aa73d0b460bb {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 16:58:42.832790 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e18ee49e-3bbd-4cca-ae7e-0185ef0d225c', 'tag': 'ecc1fde7-837e-4490-b1f8-93b04ddaab48', 'status': 'completed', 'code': 200} Sep 01 16:58:42.841764 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960e103a-4673-4b45-a57e-f51a823769c5 req-e6cc8adb-75fe-4100-867b-fcf3b8336811 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:42.851266 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-960e103a-4673-4b45-a57e-f51a823769c5 req-e6cc8adb-75fe-4100-867b-fcf3b8336811 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 943 time: 0.1623464 Sep 01 16:58:42.879163 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] For port e3d13334-c7d0-4f40-a25b-5c27c5f90c65, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=e3d13334-c7d0-4f40-a25b-5c27c5f90c65,segment=NetworkSegment(9dfcf32c-db95-455a-ac7a-283312e9c7a0),segment_id=9dfcf32c-db95-455a-ac7a-283312e9c7a0)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:58:42.888793 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496c01e4-a58d-4e9e-8187-211faab46a88 req-6553a899-4ef1-4010-9d50-4c5751d1b24e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:42.890074 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-496c01e4-a58d-4e9e-8187-211faab46a88 req-6553a899-4ef1-4010-9d50-4c5751d1b24e service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7032b30e75954f8da9ad2cb64f1f5ad1&device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 1096 time: 0.1234951 Sep 01 16:58:42.905824 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:42.947705 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-960e103a-4673-4b45-a57e-f51a823769c5 req-426e831f-e387-4839-8fe4-1337f636b32d tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0953844 Sep 01 16:58:43.007596 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for port, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:43.009420 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:43.010063 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:43.011706 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a827f03a-f203-46bc-b574-d22f6755a408 req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] 10.222.0.69 "PUT /v2.0/ports/e3d13334-c7d0-4f40-a25b-5c27c5f90c65 HTTP/1.1" status: 200 len: 1093 time: 2.7290590 Sep 01 16:58:43.016178 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:43.079668 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42e3a9e0-5dc7-4970-9f5e-5fc3b80193f5 req-70afbbae-a6b3-4a5c-9e49-75734ee197f4 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:43.083497 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcd6fcef-3858-4f80-8738-85dd9f195caa service neutron] Pushing event updated for resources: {'Port': ['ID=e3d13334-c7d0-4f40-a25b-5c27c5f90c65,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:43.088683 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-42e3a9e0-5dc7-4970-9f5e-5fc3b80193f5 req-70afbbae-a6b3-4a5c-9e49-75734ee197f4 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 943 time: 0.1579926 Sep 01 16:58:43.100272 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:43.121740 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-603318cf-2b13-4b8d-a15d-3ef639c25e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Allocated IP 172.20.0.8 (63606bb0-66bd-46d6-ba6c-55c6da830865/fd331d5b-40b1-4163-8537-7af4e56f1efd/5e47292e-406f-4ed9-9215-3dcfba5fcde4) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:58:43.155395 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event updated for resources: {'Port': ['ID=016c7291-49f2-4c8d-ad7e-c4b7f9a9bba2,revision_number=2']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:43.161049 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-42e3a9e0-5dc7-4970-9f5e-5fc3b80193f5 req-0f7b6409-ec18-4db4-ba80-ab610f15ce8d tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708528 Sep 01 16:58:43.162894 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:43.164436 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-82480a1b-ad73-4b19-bc3a-b52574d65a8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 3.1777339 Sep 01 16:58:43.187348 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 51100) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:43.315574 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-603318cf-2b13-4b8d-a15d-3ef639c25e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:43.362026 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-603318cf-2b13-4b8d-a15d-3ef639c25e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:43.401683 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-603318cf-2b13-4b8d-a15d-3ef639c25e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Network 63606bb0-66bd-46d6-ba6c-55c6da830865 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:58:43.406375 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-603318cf-2b13-4b8d-a15d-3ef639c25e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:43.409469 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-603318cf-2b13-4b8d-a15d-3ef639c25e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:58:43.440133 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c7c687ce-18d4-42fa-98ea-bb854d015ab6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:43.459974 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-603318cf-2b13-4b8d-a15d-3ef639c25e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Pushing event updated for resources: {'Port': ['ID=5e47292e-406f-4ed9-9215-3dcfba5fcde4,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:43.488223 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-603318cf-2b13-4b8d-a15d-3ef639c25e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:43.489200 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-603318cf-2b13-4b8d-a15d-3ef639c25e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:43.499743 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-1d176158-4b75-49f7-a675-1d7f4033d30f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?name=tempest-securitygroup--1156409468&fields=id&tenant_id=af7d370157f84ca198eb86180115a76f HTTP/1.1" status: 200 len: 267 time: 0.1080263 Sep 01 16:58:43.700667 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82ff3594-4418-42c9-a450-250937bfb502 req-6c052be7-1ee2-47af-80e6-6c69bed260ad tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:43.702487 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-82ff3594-4418-42c9-a450-250937bfb502 req-6c052be7-1ee2-47af-80e6-6c69bed260ad tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 931 time: 0.1250470 Sep 01 16:58:43.764378 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-d4642426-ef70-40f4-bd45-e33c49fecf1d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:43.766433 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-d4642426-ef70-40f4-bd45-e33c49fecf1d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/networks?id=2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 200 len: 816 time: 0.2653992 Sep 01 16:58:43.804716 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-82ff3594-4418-42c9-a450-250937bfb502 req-15d75514-3bfe-4519-b62f-53247f4a0687 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0942669 Sep 01 16:58:43.814820 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c7c687ce-18d4-42fa-98ea-bb854d015ab6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:43.817051 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-9e7124bc-5ce0-4ba1-88bf-35e48f3089be tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/quotas/af7d370157f84ca198eb86180115a76f HTTP/1.1" status: 200 len: 375 time: 0.0387304 Sep 01 16:58:43.828361 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c7c687ce-18d4-42fa-98ea-bb854d015ab6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:43.828562 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-603318cf-2b13-4b8d-a15d-3ef639c25e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7910209 Sep 01 16:58:43.903010 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 51144) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:43.903246 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c7c687ce-18d4-42fa-98ea-bb854d015ab6 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=fc1b3e40217545b98470d9177cfd7f88&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7139649 Sep 01 16:58:43.907296 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7c687ce-18d4-42fa-98ea-bb854d015ab6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e50995e-7986-45e5-8741-ad0cf55826b3,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:43.922510 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-6b21394f-29a2-43af-96a6-e4bf8fed7204 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0947134 Sep 01 16:58:43.972340 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3404aeb7-8963-414a-b1da-94052844563b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:44.031871 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3404aeb7-8963-414a-b1da-94052844563b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:44.094628 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3404aeb7-8963-414a-b1da-94052844563b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:44.097349 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3404aeb7-8963-414a-b1da-94052844563b admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:44.100957 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-3404aeb7-8963-414a-b1da-94052844563b admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/6e50995e-7986-45e5-8741-ad0cf55826b3 HTTP/1.1" status: 204 len: 168 time: 0.1942563 Sep 01 16:58:44.101078 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19a58c5a-76c3-4e00-bf1b-945954138e21 req-79169b34-ac0d-4e0d-8d25-ddba2f0e3f3d tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:44.101078 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-19a58c5a-76c3-4e00-bf1b-945954138e21 req-79169b34-ac0d-4e0d-8d25-ddba2f0e3f3d tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 943 time: 0.0867226 Sep 01 16:58:44.111378 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3404aeb7-8963-414a-b1da-94052844563b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e50995e-7986-45e5-8741-ad0cf55826b3,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:44.129931 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-e3a37f56-1c32-411e-94d9-a65c3a282606 service neutron] 10.222.0.67 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1854091 Sep 01 16:58:44.177504 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-19a58c5a-76c3-4e00-bf1b-945954138e21 req-73978731-20e6-4435-b6fd-4c6512cddc47 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670347 Sep 01 16:58:44.283262 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-ab78cb9e-c16d-44e5-9600-74d788bb924b service neutron] 10.222.0.67 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1394379 Sep 01 16:58:44.353609 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-472c8b89-6e67-483b-af97-fbda39334913 req-333ccb76-d6fb-44a7-bb85-69f4eb007a3f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:44.355113 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-472c8b89-6e67-483b-af97-fbda39334913 req-333ccb76-d6fb-44a7-bb85-69f4eb007a3f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 943 time: 0.0672457 Sep 01 16:58:44.405262 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-472c8b89-6e67-483b-af97-fbda39334913 req-21c54d31-9e98-4f43-ac46-5f26784e1374 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425458 Sep 01 16:58:44.494266 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7089c014-e8bb-4b3d-9196-259083921d2d req-57af0cf7-f88e-4039-80df-881889ea843e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 210 time: 0.0329823 Sep 01 16:58:44.607109 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 51180) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:44.625978 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b953c3fa-fc05-48ee-968a-567c50911dc8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:44.754436 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b953c3fa-fc05-48ee-968a-567c50911dc8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:44.758780 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b953c3fa-fc05-48ee-968a-567c50911dc8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:44.801247 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-b953c3fa-fc05-48ee-968a-567c50911dc8 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=9b6451a95592436f8b20ea8a2ee93d91&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1930587 Sep 01 16:58:44.802812 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b953c3fa-fc05-48ee-968a-567c50911dc8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1666bf3a-c4d2-42e1-92be-fa3430aef1f7,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:44.803972 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 51198) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:44.841329 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '84bd0410-fb41-4744-970f-c2402a7faf77', 'tag': 'e3d13334-c7d0-4f40-a25b-5c27c5f90c65'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 16:58:44.843833 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2d08cca5-7f3e-4d77-8133-ea8ba80e9f0e" -d '{"events": [{"name": "network-changed", "server_uuid": "84bd0410-fb41-4744-970f-c2402a7faf77", "tag": "e3d13334-c7d0-4f40-a25b-5c27c5f90c65"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 16:58:44.870121 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ed4d7e5c-96aa-4d02-97d3-56f32572b7e5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:44.897696 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ed4d7e5c-96aa-4d02-97d3-56f32572b7e5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:44.936549 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 16:58:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de6f4d84-8795-4b44-98c0-725712b10a4b x-openstack-request-id: req-de6f4d84-8795-4b44-98c0-725712b10a4b {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 16:58:44.936852 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "84bd0410-fb41-4744-970f-c2402a7faf77", "tag": "e3d13334-c7d0-4f40-a25b-5c27c5f90c65", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 16:58:44.937103 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-de6f4d84-8795-4b44-98c0-725712b10a4b {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 16:58:44.937569 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '84bd0410-fb41-4744-970f-c2402a7faf77', 'tag': 'e3d13334-c7d0-4f40-a25b-5c27c5f90c65', 'status': 'completed', 'code': 200} Sep 01 16:58:44.963405 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ed4d7e5c-96aa-4d02-97d3-56f32572b7e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:44.966096 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ed4d7e5c-96aa-4d02-97d3-56f32572b7e5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:44.969722 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-ed4d7e5c-96aa-4d02-97d3-56f32572b7e5 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/1666bf3a-c4d2-42e1-92be-fa3430aef1f7 HTTP/1.1" status: 204 len: 168 time: 0.1621766 Sep 01 16:58:44.969870 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c10737f1-cb06-45e4-90e4-e8585a2afc56 req-5e2da9c9-3bb5-457c-a57a-06b0f0530910 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:44.969870 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c10737f1-cb06-45e4-90e4-e8585a2afc56 req-5e2da9c9-3bb5-457c-a57a-06b0f0530910 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 931 time: 0.0638037 Sep 01 16:58:44.983023 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed4d7e5c-96aa-4d02-97d3-56f32572b7e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1666bf3a-c4d2-42e1-92be-fa3430aef1f7,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:45.014209 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c10737f1-cb06-45e4-90e4-e8585a2afc56 req-e5c6b423-fa1b-4208-a5c5-27a56396bb72 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384305 Sep 01 16:58:45.114822 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 51212) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:45.269051 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2d04d9b3-da2e-4d25-928d-417df40cbd3f admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:45.318653 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3c1a6f9-ef63-4ccb-9e5a-723a8520b496 req-93474434-ea12-401d-8572-9f56c7096731 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:45.320305 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f3c1a6f9-ef63-4ccb-9e5a-723a8520b496 req-93474434-ea12-401d-8572-9f56c7096731 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 943 time: 0.0569754 Sep 01 16:58:45.366862 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f3c1a6f9-ef63-4ccb-9e5a-723a8520b496 req-cdfa53e3-2a14-4384-82ba-28f3879a1452 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358078 Sep 01 16:58:45.403059 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2d04d9b3-da2e-4d25-928d-417df40cbd3f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:45.407115 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2d04d9b3-da2e-4d25-928d-417df40cbd3f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:45.449834 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d04d9b3-da2e-4d25-928d-417df40cbd3f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc4bfddd-eebb-4f36-81b0-23f8d71b049c,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:45.454462 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-2d04d9b3-da2e-4d25-928d-417df40cbd3f admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=6a07dc58d38c4a13a94c55b26bd75480&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3385901 Sep 01 16:58:45.457138 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 51234) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:45.516017 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d87459c2-a51b-47bd-901b-414b26230bc5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:45.546436 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d87459c2-a51b-47bd-901b-414b26230bc5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:45.604732 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d87459c2-a51b-47bd-901b-414b26230bc5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:45.607801 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d87459c2-a51b-47bd-901b-414b26230bc5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:45.609288 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-d87459c2-a51b-47bd-901b-414b26230bc5 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/cc4bfddd-eebb-4f36-81b0-23f8d71b049c HTTP/1.1" status: 204 len: 168 time: 0.1509447 Sep 01 16:58:45.618273 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d87459c2-a51b-47bd-901b-414b26230bc5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc4bfddd-eebb-4f36-81b0-23f8d71b049c,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:45.622519 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-520a2170-c5f2-4a28-a389-9e8d3cb57de1 req-55b6b0b7-1ec2-41ac-9f26-34753ac94f89 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:45.627262 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-520a2170-c5f2-4a28-a389-9e8d3cb57de1 req-55b6b0b7-1ec2-41ac-9f26-34753ac94f89 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 943 time: 0.1081526 Sep 01 16:58:45.688417 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9cd5f64f-f729-4455-8e3a-f616cbe67198 req-bc14607b-7ae7-4395-b962-93421cc9f0fe tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 210 time: 0.0490544 Sep 01 16:58:45.707045 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-520a2170-c5f2-4a28-a389-9e8d3cb57de1 req-31f27574-fa0f-4f29-8137-7b966bcb2ede tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585835 Sep 01 16:58:45.801487 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Request body: {'port': {'device_id': '891d0bc6-0f97-45d5-a4d2-d329fbe22fd6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:45.890079 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3726ec20-614f-4c65-9308-4414581823b8 req-c857b216-bd0b-47b4-9a27-97d17d6f7866 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:45.892931 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-c857b216-bd0b-47b4-9a27-97d17d6f7866 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=9b4a4924-07f0-4c55-a14a-c9f863402ba1 HTTP/1.1" status: 200 len: 851 time: 0.1399815 Sep 01 16:58:45.970891 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496c01e4-a58d-4e9e-8187-211faab46a88 req-a6b58879-0122-405e-a3c7-ff6fcf78de36 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:45.974030 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-496c01e4-a58d-4e9e-8187-211faab46a88 req-a6b58879-0122-405e-a3c7-ff6fcf78de36 service neutron] 10.222.0.69 "GET /v2.0/networks?id=8331b65a-166e-454c-a3c5-ed861dc82dfc HTTP/1.1" status: 200 len: 915 time: 0.2086294 Sep 01 16:58:46.029951 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-496c01e4-a58d-4e9e-8187-211faab46a88 req-cf8b5e16-e0df-458d-9bd0-23e382cfb3f4 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=3890e11d-5295-488a-9033-9814bb94bf69 HTTP/1.1" status: 200 len: 217 time: 0.0474927 Sep 01 16:58:46.104151 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-9676b2fd-32f3-4177-a42b-16cd8895159a service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=4af50d67-ae76-48e9-804b-cf2e7dc7f714&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1688046 Sep 01 16:58:46.157012 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 51264) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:46.172441 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496c01e4-a58d-4e9e-8187-211faab46a88 req-cf18c6d0-2915-4cd7-8276-d0419686f17a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:46.174180 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-496c01e4-a58d-4e9e-8187-211faab46a88 req-cf18c6d0-2915-4cd7-8276-d0419686f17a service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd025a14-8839-4451-a03e-bc7daeb612d0 HTTP/1.1" status: 200 len: 854 time: 0.1184571 Sep 01 16:58:46.174509 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a827f03a-f203-46bc-b574-d22f6755a408 req-2684417d-3102-4ad4-a082-08f7e7a6e882 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:46.176021 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a827f03a-f203-46bc-b574-d22f6755a408 req-2684417d-3102-4ad4-a082-08f7e7a6e882 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=4199ca0b18374af7856c19238fc2fea1&device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 1096 time: 0.3544397 Sep 01 16:58:46.178523 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:46.188882 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-678a7346-b93f-4f10-a371-1af707ddcfde req-334effe1-ceaf-4fc8-830c-4c53ca413a73 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:46.190506 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-678a7346-b93f-4f10-a371-1af707ddcfde req-334effe1-ceaf-4fc8-830c-4c53ca413a73 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 931 time: 0.0791707 Sep 01 16:58:46.192566 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-33a0a78d-fa48-47cc-9fc6-c529785945e2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:46.228467 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-496c01e4-a58d-4e9e-8187-211faab46a88 req-dd198bb2-4ed6-4634-9bdc-dbc4be533ad8 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8331b65a-166e-454c-a3c5-ed861dc82dfc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0368688 Sep 01 16:58:46.245253 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a827f03a-f203-46bc-b574-d22f6755a408 req-0e95ce3f-2ec8-4569-ba67-6568a5943a35 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e3d13334-c7d0-4f40-a25b-5c27c5f90c65 HTTP/1.1" status: 200 len: 217 time: 0.0461550 Sep 01 16:58:46.350451 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-b52ac264-5f9d-43b3-861a-c631507c5e73 service neutron] 10.222.0.69 "GET /v2.0/networks/4af50d67-ae76-48e9-804b-cf2e7dc7f714?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2343450 Sep 01 16:58:46.372134 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a827f03a-f203-46bc-b574-d22f6755a408 req-6ad88204-54e6-4059-a4dd-348e49f1489d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:46.374043 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a827f03a-f203-46bc-b574-d22f6755a408 req-6ad88204-54e6-4059-a4dd-348e49f1489d service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd331d5b-40b1-4163-8537-7af4e56f1efd HTTP/1.1" status: 200 len: 859 time: 0.0988076 Sep 01 16:58:46.476931 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.69', 52085) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:46.517311 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a827f03a-f203-46bc-b574-d22f6755a408 req-fdb1a689-05b7-4b31-9128-ce93dca35913 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=63606bb0-66bd-46d6-ba6c-55c6da830865&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0930202 Sep 01 16:58:46.620044 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-678a7346-b93f-4f10-a371-1af707ddcfde req-162894cd-b056-4e8e-887b-25f60c26782f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4116859 Sep 01 16:58:46.640598 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-496c01e4-a58d-4e9e-8187-211faab46a88 req-ade7856f-6306-4d24-96f9-549517c11371 service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4017355 Sep 01 16:58:46.674945 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ec60e9c-0b2c-4f07-90ed-c154005294cc req-59603e9a-e03d-4f7b-8fe1-3dc72628ac9f tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:46.676538 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9ec60e9c-0b2c-4f07-90ed-c154005294cc req-59603e9a-e03d-4f7b-8fe1-3dc72628ac9f tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 943 time: 0.1293657 Sep 01 16:58:46.766274 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3726ec20-614f-4c65-9308-4414581823b8 req-5e4e5d78-bb02-41e5-aa72-85fe52a52a43 service neutron] 10.222.0.69 "GET /v2.0/networks/4af50d67-ae76-48e9-804b-cf2e7dc7f714?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4062710 Sep 01 16:58:46.817660 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-0951bece-29c2-492d-b9a5-adfab99da0fb tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:46.819985 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-0951bece-29c2-492d-b9a5-adfab99da0fb tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.69 "GET /v2.0/networks?id=2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 200 len: 816 time: 0.3399851 Sep 01 16:58:46.847026 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a827f03a-f203-46bc-b574-d22f6755a408 req-40b302d7-84a9-4e21-b01a-56b506ceab80 service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2840600 Sep 01 16:58:46.863554 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d909b6b9-5d54-491f-a846-5ec950d64c1c req-b4eb6753-7548-452a-9994-34830fe63041 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 210 time: 0.0652502 Sep 01 16:58:46.876585 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9ec60e9c-0b2c-4f07-90ed-c154005294cc req-33713083-63ef-4b8f-8982-9aef4267295f tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1876507 Sep 01 16:58:46.959626 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-33a0a78d-fa48-47cc-9fc6-c529785945e2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:46.987006 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-496c01e4-a58d-4e9e-8187-211faab46a88 req-c1902a65-b12d-48c9-b58a-bbf536f3d74e service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3250709 Sep 01 16:58:46.987676 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-33a0a78d-fa48-47cc-9fc6-c529785945e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:47.106979 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-33a0a78d-fa48-47cc-9fc6-c529785945e2 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=8978cd0804054251bb28afcf472768ba&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9449980 Sep 01 16:58:47.110707 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 51308) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:47.117942 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a0a78d-fa48-47cc-9fc6-c529785945e2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3774f1f7-d4c3-4eac-a49f-d75bdcb651de,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:47.190340 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e9e897-4a3f-487e-8dd2-7575a2026025 req-f99f5de5-d2ce-486a-89d6-95e20eceefa1 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:47.191923 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b8e9e897-4a3f-487e-8dd2-7575a2026025 req-f99f5de5-d2ce-486a-89d6-95e20eceefa1 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 943 time: 0.2013922 Sep 01 16:58:47.247160 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fb66bcc6-f68a-48dd-8a05-918ccefbb869 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:47.303681 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b8e9e897-4a3f-487e-8dd2-7575a2026025 req-8f861c07-89e8-4a84-afc8-2dbb58ac7f9b tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1032014 Sep 01 16:58:47.305982 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fb66bcc6-f68a-48dd-8a05-918ccefbb869 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:47.392738 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fb66bcc6-f68a-48dd-8a05-918ccefbb869 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:47.398101 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fb66bcc6-f68a-48dd-8a05-918ccefbb869 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:47.399993 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-fb66bcc6-f68a-48dd-8a05-918ccefbb869 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/3774f1f7-d4c3-4eac-a49f-d75bdcb651de HTTP/1.1" status: 204 len: 168 time: 0.2881503 Sep 01 16:58:47.401214 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-81199b9d-a581-4727-bd30-a4de22dbf769 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=af7d370157f84ca198eb86180115a76f HTTP/1.1" status: 200 len: 380 time: 0.5472953 Sep 01 16:58:47.408758 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13b3082-8086-4c3b-9180-d34b453c320f req-7fb45d3d-a176-4990-8713-1a00a6824335 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:47.410533 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f13b3082-8086-4c3b-9180-d34b453c320f req-7fb45d3d-a176-4990-8713-1a00a6824335 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=76cfc4ed03034fdc9e2ce4a3580959f7&device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 1096 time: 0.5708089 Sep 01 16:58:47.419612 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb66bcc6-f68a-48dd-8a05-918ccefbb869 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3774f1f7-d4c3-4eac-a49f-d75bdcb651de,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:47.435743 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-308213f6-d732-450e-86d4-4a152753b6e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Request body: {'port': {'device_id': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'admin_state_up': True, 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'security_groups': ['5fc77e84-de9d-44e5-b947-11c478e5af40']}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:47.483092 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5e47292e-406f-4ed9-9215-3dcfba5fcde4 {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 16:58:47.493347 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:47.509428 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Transition to ACTIVE for port object 5e47292e-406f-4ed9-9215-3dcfba5fcde4 will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:58:47.600120 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:47.728484 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a827f03a-f203-46bc-b574-d22f6755a408 req-afe3fe66-622f-480e-a44b-309618c592d1 service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8055549 Sep 01 16:58:47.806982 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Pushing event updated for resources: {'Port': ['ID=5e47292e-406f-4ed9-9215-3dcfba5fcde4,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:47.834412 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cb95b6c-5f44-4860-9a0d-99745291b08b req-d63a5f45-08a8-438f-b5dc-461d9e29b5d0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:47.844345 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0cb95b6c-5f44-4860-9a0d-99745291b08b req-d63a5f45-08a8-438f-b5dc-461d9e29b5d0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 943 time: 0.1040342 Sep 01 16:58:47.880318 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13b3082-8086-4c3b-9180-d34b453c320f req-3576c4e3-0760-483d-a947-b03b057b6aa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:47.882101 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f13b3082-8086-4c3b-9180-d34b453c320f req-3576c4e3-0760-483d-a947-b03b057b6aa2 service neutron] 10.222.0.69 "GET /v2.0/networks?id=4af50d67-ae76-48e9-804b-cf2e7dc7f714 HTTP/1.1" status: 200 len: 912 time: 0.3688769 Sep 01 16:58:47.884553 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-308213f6-d732-450e-86d4-4a152753b6e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Made reservation on behalf of af7d370157f84ca198eb86180115a76f for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:58:47.888673 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-308213f6-d732-450e-86d4-4a152753b6e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:47.895331 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0cb95b6c-5f44-4860-9a0d-99745291b08b req-7a8e5b01-69e2-4d7b-9951-1c088444da47 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498512 Sep 01 16:58:47.976897 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Attempting to bind port 5e47292e-406f-4ed9-9215-3dcfba5fcde4 on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:58:47.977235 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Attempting to bind port 5e47292e-406f-4ed9-9215-3dcfba5fcde4 by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': '9dfcf32c-db95-455a-ac7a-283312e9c7a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:58:47.977596 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Attempting to bind port 5e47292e-406f-4ed9-9215-3dcfba5fcde4 on network 63606bb0-66bd-46d6-ba6c-55c6da830865 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:47.990797 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Port 5e47292e-406f-4ed9-9215-3dcfba5fcde4 on network 63606bb0-66bd-46d6-ba6c-55c6da830865 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 16:58:47.991126 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Attempting to bind port 5e47292e-406f-4ed9-9215-3dcfba5fcde4 on network 63606bb0-66bd-46d6-ba6c-55c6da830865 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:48.007120 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 58, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:58:48.007469 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Checking segment: {'id': '9dfcf32c-db95-455a-ac7a-283312e9c7a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:48.007850 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Bound using segment: {'id': '9dfcf32c-db95-455a-ac7a-283312e9c7a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:58:48.008462 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Bound port: 5e47292e-406f-4ed9-9215-3dcfba5fcde4, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9dfcf32c-db95-455a-ac7a-283312e9c7a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:58:48.008819 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:48.035324 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7829dd07-ee54-4c06-be28-5152835f28fe req-80bfa1e0-83bc-455d-b3b2-22edc25336b2 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 210 time: 0.0397475 Sep 01 16:58:48.090095 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0f7bbab-539d-4d5d-81a0-3bf6390fa2fc req-486bb876-8737-45d3-8fae-01b2606708eb tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:48.092142 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d0f7bbab-539d-4d5d-81a0-3bf6390fa2fc req-486bb876-8737-45d3-8fae-01b2606708eb tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 943 time: 0.0850575 Sep 01 16:58:48.109282 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-308213f6-d732-450e-86d4-4a152753b6e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Allocated IP 172.20.0.7 (2f7bfe5e-0012-467f-ad7f-aea2467233ac/58fe425a-6b3e-47bd-b5c0-e68ea7782780/f3cd3382-a1bb-4f12-b1b1-64bd000296fb) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:58:48.140625 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] For port 5e47292e-406f-4ed9-9215-3dcfba5fcde4, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:58:48.146027 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] For port 5e47292e-406f-4ed9-9215-3dcfba5fcde4, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=5e47292e-406f-4ed9-9215-3dcfba5fcde4,segment=NetworkSegment(9dfcf32c-db95-455a-ac7a-283312e9c7a0),segment_id=9dfcf32c-db95-455a-ac7a-283312e9c7a0)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:58:48.146717 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d0f7bbab-539d-4d5d-81a0-3bf6390fa2fc req-7bfac13c-a7fd-4859-acd0-3228ad8d569a tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485601 Sep 01 16:58:48.153758 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:48.245622 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:48.249169 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:48.249169 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] 10.222.0.69 "PUT /v2.0/ports/5e47292e-406f-4ed9-9215-3dcfba5fcde4 HTTP/1.1" status: 200 len: 1093 time: 2.4621780 Sep 01 16:58:48.249169 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '891d0bc6-0f97-45d5-a4d2-d329fbe22fd6', 'tag': '5e47292e-406f-4ed9-9215-3dcfba5fcde4'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 16:58:48.250456 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8520b49-90d3-441e-9328-2daab31198f3" -d '{"events": [{"name": "network-changed", "server_uuid": "891d0bc6-0f97-45d5-a4d2-d329fbe22fd6", "tag": "5e47292e-406f-4ed9-9215-3dcfba5fcde4"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 16:58:48.279998 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-794babe9-de84-44ce-904c-0b4bf4183a3e service neutron] Pushing event updated for resources: {'Port': ['ID=5e47292e-406f-4ed9-9215-3dcfba5fcde4,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:48.293929 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 16:58:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a1a7383-d98f-48f9-866d-e40208ff8684 x-openstack-request-id: req-9a1a7383-d98f-48f9-866d-e40208ff8684 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 16:58:48.294219 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "891d0bc6-0f97-45d5-a4d2-d329fbe22fd6", "tag": "5e47292e-406f-4ed9-9215-3dcfba5fcde4", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 16:58:48.294464 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-9a1a7383-d98f-48f9-866d-e40208ff8684 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 16:58:48.294851 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '891d0bc6-0f97-45d5-a4d2-d329fbe22fd6', 'tag': '5e47292e-406f-4ed9-9215-3dcfba5fcde4', 'status': 'completed', 'code': 200} Sep 01 16:58:48.338599 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-308213f6-d732-450e-86d4-4a152753b6e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:48.355155 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-308213f6-d732-450e-86d4-4a152753b6e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Transition to ACTIVE for port object f3cd3382-a1bb-4f12-b1b1-64bd000296fb will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:58:48.398246 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-308213f6-d732-450e-86d4-4a152753b6e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:48.462869 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-308213f6-d732-450e-86d4-4a152753b6e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Network 2f7bfe5e-0012-467f-ad7f-aea2467233ac is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:58:48.466064 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-308213f6-d732-450e-86d4-4a152753b6e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:58:48.470032 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-308213f6-d732-450e-86d4-4a152753b6e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:58:48.473895 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d25f34e9-5ebd-418e-b279-12a35a948a30 req-35fd7303-62e7-4dda-8ca4-63da2aab47be tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:48.475816 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d25f34e9-5ebd-418e-b279-12a35a948a30 req-35fd7303-62e7-4dda-8ca4-63da2aab47be tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 943 time: 0.0654297 Sep 01 16:58:48.529867 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-308213f6-d732-450e-86d4-4a152753b6e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event updated for resources: {'Port': ['ID=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:48.546795 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d25f34e9-5ebd-418e-b279-12a35a948a30 req-9c51f68d-6a5a-4603-8d3d-a031f7d79573 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618246 Sep 01 16:58:48.570612 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-308213f6-d732-450e-86d4-4a152753b6e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:48.571298 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-308213f6-d732-450e-86d4-4a152753b6e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:48.590817 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-308213f6-d732-450e-86d4-4a152753b6e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1783674 Sep 01 16:58:48.764609 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-f45f5be2-56e1-4b15-b38e-df58bbec7ceb None None] Provisioning for port f3cd3382-a1bb-4f12-b1b1-64bd000296fb completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:58:48.768770 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-f45f5be2-56e1-4b15-b38e-df58bbec7ceb None None] Provisioning complete for port f3cd3382-a1bb-4f12-b1b1-64bd000296fb triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:48.769147 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-f45f5be2-56e1-4b15-b38e-df58bbec7ceb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:48.805856 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-f45f5be2-56e1-4b15-b38e-df58bbec7ceb None None] Port f3cd3382-a1bb-4f12-b1b1-64bd000296fb cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 16:58:49.069222 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddec9c81-a454-420c-bfc9-203ef75cd98e req-4ef5e2e4-011f-41bf-a11f-43ef1828bf0a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:49.071333 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ddec9c81-a454-420c-bfc9-203ef75cd98e req-4ef5e2e4-011f-41bf-a11f-43ef1828bf0a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 943 time: 0.0668859 Sep 01 16:58:49.126016 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ddec9c81-a454-420c-bfc9-203ef75cd98e req-892eff6b-f2fd-4292-b254-45abe5f022dc tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442822 Sep 01 16:58:49.184500 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b64dd28c-f53d-40ef-9571-8ec164b2ad55 req-4ce81bf6-36b1-4ee5-8748-6b135a9c3202 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:49.192253 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b64dd28c-f53d-40ef-9571-8ec164b2ad55 req-4ce81bf6-36b1-4ee5-8748-6b135a9c3202 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 931 time: 0.0642152 Sep 01 16:58:49.240190 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b64dd28c-f53d-40ef-9571-8ec164b2ad55 req-bbe6dcbb-646d-4499-9c00-5a0c5591cc03 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452237 Sep 01 16:58:49.317237 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a81dff50-3d4a-4693-a825-8709fa0d4cbe req-bf0a25a4-5d62-41f1-9fb4-1b1be4f0f61b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:49.318850 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a81dff50-3d4a-4693-a825-8709fa0d4cbe req-bf0a25a4-5d62-41f1-9fb4-1b1be4f0f61b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 943 time: 0.0685737 Sep 01 16:58:49.358322 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a81dff50-3d4a-4693-a825-8709fa0d4cbe req-d81e03d7-0150-4f3a-b28d-e5f0d6e60813 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326393 Sep 01 16:58:49.670296 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cadb61a8-7f3a-47c0-819d-e82201d936ae req-4fcc8c65-0d41-41e4-8615-5cbc97b14be6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:49.671789 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cadb61a8-7f3a-47c0-819d-e82201d936ae req-4fcc8c65-0d41-41e4-8615-5cbc97b14be6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 943 time: 0.0540791 Sep 01 16:58:49.709426 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cadb61a8-7f3a-47c0-819d-e82201d936ae req-fea41876-e245-4b3f-9e80-6de9e379cc04 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317860 Sep 01 16:58:50.247906 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b95190f-e844-499b-8e30-5fe18dfb1464 req-1e837e13-4354-4954-8f3d-ace4dc71a5dc tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:50.249366 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2b95190f-e844-499b-8e30-5fe18dfb1464 req-1e837e13-4354-4954-8f3d-ace4dc71a5dc tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 943 time: 0.0518749 Sep 01 16:58:50.287253 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2b95190f-e844-499b-8e30-5fe18dfb1464 req-6d92936b-1760-4890-b88f-7a34e4a2619d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320663 Sep 01 16:58:50.355615 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-600c12d6-1e3d-4361-abba-0702daed8836 req-1bf1cfd0-00ca-4318-84e1-f7e2ca6dacc2 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:50.357094 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-600c12d6-1e3d-4361-abba-0702daed8836 req-1bf1cfd0-00ca-4318-84e1-f7e2ca6dacc2 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 931 time: 0.0530901 Sep 01 16:58:50.394216 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-600c12d6-1e3d-4361-abba-0702daed8836 req-63d1d53b-c2b1-4446-9760-3e1f80bcd35b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0311327 Sep 01 16:58:50.475904 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0df1e89-5d0d-4b67-9570-e611fdd888ba req-1f51dfde-2e7a-4692-80aa-ad40009fde3b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:50.477379 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c0df1e89-5d0d-4b67-9570-e611fdd888ba req-1f51dfde-2e7a-4692-80aa-ad40009fde3b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 943 time: 0.0492282 Sep 01 16:58:50.516993 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c0df1e89-5d0d-4b67-9570-e611fdd888ba req-f287bb57-6671-4c58-9802-c93a85cc3f54 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0335443 Sep 01 16:58:50.764818 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device ecc1fde7-837e-4490-b1f8-93b04ddaab48 details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 16:58:50.786115 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Request body: {'port': {'device_id': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:58:50.841664 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0328bd8-9693-48d7-a133-b2ccdff790b3 req-847087df-19fa-4b97-99d8-195a7084793f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:50.843741 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a0328bd8-9693-48d7-a133-b2ccdff790b3 req-847087df-19fa-4b97-99d8-195a7084793f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 943 time: 0.0596728 Sep 01 16:58:50.895181 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a0328bd8-9693-48d7-a133-b2ccdff790b3 req-885771e6-d80d-44d2-8db9-0f78771cbdb6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412979 Sep 01 16:58:50.903337 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port ecc1fde7-837e-4490-b1f8-93b04ddaab48, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=ecc1fde7-837e-4490-b1f8-93b04ddaab48,segment=NetworkSegment(2785b39f-9a72-4d03-a737-382dced1c97a),segment_id=2785b39f-9a72-4d03-a737-382dced1c97a)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:58:50.918057 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'ecc1fde7-837e-4490-b1f8-93b04ddaab48', 'network_id': '4af50d67-ae76-48e9-804b-cf2e7dc7f714', 'port_id': 'ecc1fde7-837e-4490-b1f8-93b04ddaab48', 'mac_address': 'fa:16:3e:9b:88:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 532, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9b4a4924-07f0-4c55-a14a-c9f863402ba1', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 16:58:50.920571 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f13b3082-8086-4c3b-9180-d34b453c320f req-7b807a29-46d0-4755-8f1a-37732d89334c service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ecc1fde7-837e-4490-b1f8-93b04ddaab48 HTTP/1.1" status: 200 len: 217 time: 0.1282537 Sep 01 16:58:50.956482 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:50.970037 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ecc1fde7-837e-4490-b1f8-93b04ddaab48 {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 16:58:50.992135 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port ecc1fde7-837e-4490-b1f8-93b04ddaab48, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=ecc1fde7-837e-4490-b1f8-93b04ddaab48,segment=NetworkSegment(2785b39f-9a72-4d03-a737-382dced1c97a),segment_id=2785b39f-9a72-4d03-a737-382dced1c97a)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:58:50.996241 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:50.997080 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 3890e11d-5295-488a-9033-9814bb94bf69 details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 16:58:51.020000 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8520b49-90d3-441e-9328-2daab31198f3 req-ff080015-a3c1-4c00-b32d-c0c15bfa49f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:51.021556 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f8520b49-90d3-441e-9328-2daab31198f3 req-ff080015-a3c1-4c00-b32d-c0c15bfa49f2 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=4199ca0b18374af7856c19238fc2fea1&device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 1096 time: 0.2273941 Sep 01 16:58:51.024481 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:51.030243 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d08cca5-7f3e-4d77-8133-ea8ba80e9f0e req-08ffdc46-fcbb-4ce7-8e1a-0bce64840b36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:51.031728 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2d08cca5-7f3e-4d77-8133-ea8ba80e9f0e req-08ffdc46-fcbb-4ce7-8e1a-0bce64840b36 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=4199ca0b18374af7856c19238fc2fea1&device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 1096 time: 0.2418435 Sep 01 16:58:51.086727 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13b3082-8086-4c3b-9180-d34b453c320f req-582fc4c3-261b-49aa-b1bc-8eced4f0c99c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:51.088172 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f13b3082-8086-4c3b-9180-d34b453c320f req-582fc4c3-261b-49aa-b1bc-8eced4f0c99c service neutron] 10.222.0.69 "GET /v2.0/subnets?id=9b4a4924-07f0-4c55-a14a-c9f863402ba1 HTTP/1.1" status: 200 len: 851 time: 0.1595554 Sep 01 16:58:51.099373 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=ecc1fde7-837e-4490-b1f8-93b04ddaab48,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:51.140155 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 3890e11d-5295-488a-9033-9814bb94bf69, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=3890e11d-5295-488a-9033-9814bb94bf69,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:58:51.157779 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': '3890e11d-5295-488a-9033-9814bb94bf69', 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc', 'port_id': '3890e11d-5295-488a-9033-9814bb94bf69', 'mac_address': 'fa:16:3e:76:2f:28', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 525, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fd025a14-8839-4451-a03e-bc7daeb612d0', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 16:58:51.201249 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:51.219627 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3890e11d-5295-488a-9033-9814bb94bf69 {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 16:58:51.248707 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 3890e11d-5295-488a-9033-9814bb94bf69, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=3890e11d-5295-488a-9033-9814bb94bf69,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:58:51.250488 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-8f6a4ae7-cf76-4280-b9f7-d1570568bf4d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:51.252348 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:51.254755 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f13b3082-8086-4c3b-9180-d34b453c320f req-d0ab8d84-e733-489c-8b3c-d3a67ce2e341 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=4af50d67-ae76-48e9-804b-cf2e7dc7f714&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1264780 Sep 01 16:58:51.300001 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=3890e11d-5295-488a-9033-9814bb94bf69,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:51.429605 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbacc09f-fa05-4403-9cfa-a11387822bf7 req-309b473f-75fc-48d5-9cfd-c5de495b2c03 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:51.431816 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cbacc09f-fa05-4403-9cfa-a11387822bf7 req-309b473f-75fc-48d5-9cfd-c5de495b2c03 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 943 time: 0.0525126 Sep 01 16:58:51.476751 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cbacc09f-fa05-4403-9cfa-a11387822bf7 req-339ea40d-c845-459c-8a94-b8f04c17e56e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372181 Sep 01 16:58:51.531329 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1048561-fcce-4d77-8ba9-630f6477986a req-edc79c4c-7124-4bae-bb3e-3fe55eb5329e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:51.532858 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d1048561-fcce-4d77-8ba9-630f6477986a req-edc79c4c-7124-4bae-bb3e-3fe55eb5329e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 931 time: 0.0552065 Sep 01 16:58:51.573148 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d1048561-fcce-4d77-8ba9-630f6477986a req-388192d0-c574-4ece-83ce-fa86996a3ad5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0340796 Sep 01 16:58:51.580802 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8520b49-90d3-441e-9328-2daab31198f3 req-63bf0992-1a55-427f-937d-f7c5584a4d50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:51.582310 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f8520b49-90d3-441e-9328-2daab31198f3 req-63bf0992-1a55-427f-937d-f7c5584a4d50 service neutron] 10.222.0.69 "GET /v2.0/networks?tenant_id=4199ca0b18374af7856c19238fc2fea1&shared=False HTTP/1.1" status: 200 len: 920 time: 0.5497346 Sep 01 16:58:51.597175 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d08cca5-7f3e-4d77-8133-ea8ba80e9f0e req-c1160cc7-c790-49e2-b914-ed239c4efaef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:51.598652 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2d08cca5-7f3e-4d77-8133-ea8ba80e9f0e req-c1160cc7-c790-49e2-b914-ed239c4efaef service neutron] 10.222.0.69 "GET /v2.0/networks?id=63606bb0-66bd-46d6-ba6c-55c6da830865 HTTP/1.1" status: 200 len: 920 time: 0.5399134 Sep 01 16:58:51.654192 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fcb97d1-281a-4f29-a07e-da5448539d73 req-4ddff8de-df63-4036-ba89-95ab09556c73 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:51.655646 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0fcb97d1-281a-4f29-a07e-da5448539d73 req-4ddff8de-df63-4036-ba89-95ab09556c73 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 944 time: 0.0513732 Sep 01 16:58:51.699615 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0fcb97d1-281a-4f29-a07e-da5448539d73 req-c71408a7-f82b-4792-83f2-be5a52728306 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0370467 Sep 01 16:58:51.731115 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f3cd3382-a1bb-4f12-b1b1-64bd000296fb {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 16:58:51.738373 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:51.750663 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Transition to ACTIVE for port object f3cd3382-a1bb-4f12-b1b1-64bd000296fb will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:58:51.754275 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:51.806842 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Pushing event updated for resources: {'Port': ['ID=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:51.874085 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Attempting to bind port f3cd3382-a1bb-4f12-b1b1-64bd000296fb on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:58:51.874421 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Attempting to bind port f3cd3382-a1bb-4f12-b1b1-64bd000296fb by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:58:51.874753 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Attempting to bind port f3cd3382-a1bb-4f12-b1b1-64bd000296fb on network 2f7bfe5e-0012-467f-ad7f-aea2467233ac {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:51.879166 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Port f3cd3382-a1bb-4f12-b1b1-64bd000296fb on network 2f7bfe5e-0012-467f-ad7f-aea2467233ac not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 16:58:51.879418 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Attempting to bind port f3cd3382-a1bb-4f12-b1b1-64bd000296fb on network 2f7bfe5e-0012-467f-ad7f-aea2467233ac {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:58:51.884417 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 58, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:58:51.884750 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Checking segment: {'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:58:51.885136 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Bound using segment: {'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:58:51.885591 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Bound port: f3cd3382-a1bb-4f12-b1b1-64bd000296fb, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:58:51.885949 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:51.953221 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] For port f3cd3382-a1bb-4f12-b1b1-64bd000296fb, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:58:51.956469 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] For port f3cd3382-a1bb-4f12-b1b1-64bd000296fb, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:58:51.960334 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:51.998699 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:51.999331 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:52.000782 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] 10.222.0.69 "PUT /v2.0/ports/f3cd3382-a1bb-4f12-b1b1-64bd000296fb HTTP/1.1" status: 200 len: 1093 time: 1.2215643 Sep 01 16:58:52.003388 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'tag': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 16:58:52.006734 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-15ec2658-cde9-48bd-a9e2-49c091549d8c" -d '{"events": [{"name": "network-changed", "server_uuid": "0678fbe1-e92f-49b6-93cd-5babcfc2de18", "tag": "f3cd3382-a1bb-4f12-b1b1-64bd000296fb"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 16:58:52.013207 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d3eeae-ae02-4fc8-afab-a07827844ffa req-19088dcc-6b76-4262-a13a-481318714719 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:52.014867 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c1d3eeae-ae02-4fc8-afab-a07827844ffa req-19088dcc-6b76-4262-a13a-481318714719 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 944 time: 0.0488133 Sep 01 16:58:52.045641 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2520953a-f963-4536-a534-136c5f6704f6 service neutron] Pushing event updated for resources: {'Port': ['ID=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:52.065026 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 16:58:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-63539819-3c7d-4183-b4fb-6ca1d0d127ff x-openstack-request-id: req-63539819-3c7d-4183-b4fb-6ca1d0d127ff {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 16:58:52.065317 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0678fbe1-e92f-49b6-93cd-5babcfc2de18", "tag": "f3cd3382-a1bb-4f12-b1b1-64bd000296fb", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 16:58:52.065603 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-63539819-3c7d-4183-b4fb-6ca1d0d127ff {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 16:58:52.066000 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'tag': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'status': 'completed', 'code': 200} Sep 01 16:58:52.076376 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c1d3eeae-ae02-4fc8-afab-a07827844ffa req-57f4afb4-954a-44cb-bfa5-f2ee12acc4d6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0555241 Sep 01 16:58:52.598456 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8987b1b9-93e2-47e2-bb32-61c4315219f2 req-40e69e50-2384-4e3b-9298-7a78f30aa186 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:52.600456 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8987b1b9-93e2-47e2-bb32-61c4315219f2 req-40e69e50-2384-4e3b-9298-7a78f30aa186 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 943 time: 0.0498965 Sep 01 16:58:52.645422 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8987b1b9-93e2-47e2-bb32-61c4315219f2 req-e00e5f2c-6c8f-4a64-9531-90329036a960 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0341301 Sep 01 16:58:52.700754 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c786d42-d905-4c53-a757-5c2daf6fbbd3 req-af579236-7f9e-4b28-8013-79b495444412 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:52.702851 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8c786d42-d905-4c53-a757-5c2daf6fbbd3 req-af579236-7f9e-4b28-8013-79b495444412 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0556288 Sep 01 16:58:52.749435 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8c786d42-d905-4c53-a757-5c2daf6fbbd3 req-c6deb702-4556-4d7f-afcf-647f362f7c1f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371573 Sep 01 16:58:52.821224 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa7ca63b-d094-49e4-bf2c-fd69aac0e7ee req-bb549cfb-5391-4cf1-889d-30a6a4ccab01 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:52.822716 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-aa7ca63b-d094-49e4-bf2c-fd69aac0e7ee req-bb549cfb-5391-4cf1-889d-30a6a4ccab01 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 944 time: 0.0489359 Sep 01 16:58:52.859214 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-aa7ca63b-d094-49e4-bf2c-fd69aac0e7ee req-01cf7942-06cb-4a8c-8f2d-a825ecf30a30 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306685 Sep 01 16:58:53.188784 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1487fe13-97d3-485c-a31b-a0919207821a req-5a0400dd-cccb-4608-bdc7-373cb4c643ee tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:53.190320 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1487fe13-97d3-485c-a31b-a0919207821a req-5a0400dd-cccb-4608-bdc7-373cb4c643ee tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 944 time: 0.0487316 Sep 01 16:58:53.226737 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1487fe13-97d3-485c-a31b-a0919207821a req-deaef5eb-fe66-48b9-a796-e832b8128b9d tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306444 Sep 01 16:58:53.762819 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:53.771548 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-519b6c8d-62e8-47a3-ab61-7d90243a2da6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:53.781463 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adc5a46c-17b3-40b3-a207-f0730ad40220 req-d2f978a1-eb51-453a-9e29-75f93bf52284 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:53.783037 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-adc5a46c-17b3-40b3-a207-f0730ad40220 req-d2f978a1-eb51-453a-9e29-75f93bf52284 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 943 time: 0.0708055 Sep 01 16:58:53.821069 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-adc5a46c-17b3-40b3-a207-f0730ad40220 req-a5b01868-cd68-4212-9f06-88ae298b4e08 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321298 Sep 01 16:58:53.868827 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f28fa9-edd3-4b48-8fa3-6191ee65f07d req-06bd5909-8031-482f-ba80-f7f8c4938f6c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:53.870337 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-95f28fa9-edd3-4b48-8fa3-6191ee65f07d req-06bd5909-8031-482f-ba80-f7f8c4938f6c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0483770 Sep 01 16:58:53.910118 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-95f28fa9-edd3-4b48-8fa3-6191ee65f07d req-479a7357-cfe5-4b87-b39c-ea000227df5e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0327208 Sep 01 16:58:53.971394 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e19550-0d17-47f0-8f11-fe36f1a4aa81 req-478af454-654e-41f4-a242-6f9f3a7b0019 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:53.972837 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-28e19550-0d17-47f0-8f11-fe36f1a4aa81 req-478af454-654e-41f4-a242-6f9f3a7b0019 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 944 time: 0.0469620 Sep 01 16:58:54.009744 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-28e19550-0d17-47f0-8f11-fe36f1a4aa81 req-b673cf04-fa50-4630-9696-d869046e737a tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310531 Sep 01 16:58:54.217774 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2d08cca5-7f3e-4d77-8133-ea8ba80e9f0e req-249aa13d-a2d9-46b3-b96d-72065dc73158 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e3d13334-c7d0-4f40-a25b-5c27c5f90c65 HTTP/1.1" status: 200 len: 217 time: 0.1562693 Sep 01 16:58:54.352029 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3cd0fba-d75a-41eb-8383-c2a8cceaafad req-c7308311-2a49-43c2-a0d8-2dcf0f834fa1 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:54.354401 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['3890e11d-5295-488a-9033-9814bb94bf69'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 16:58:54.359671 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c3cd0fba-d75a-41eb-8383-c2a8cceaafad req-c7308311-2a49-43c2-a0d8-2dcf0f834fa1 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 944 time: 0.0605609 Sep 01 16:58:54.376082 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ec2658-cde9-48bd-a9e2-49c091549d8c req-9a649998-304e-4791-b553-8683e278fbb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:54.377603 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-15ec2658-cde9-48bd-a9e2-49c091549d8c req-9a649998-304e-4791-b553-8683e278fbb7 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 1096 time: 0.2618310 Sep 01 16:58:54.388132 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f13b3082-8086-4c3b-9180-d34b453c320f req-6236c83b-55ca-45a1-8a08-45d6a01a9fd9 service neutron] 10.222.0.69 "GET /v2.0/networks/4af50d67-ae76-48e9-804b-cf2e7dc7f714?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3382947 Sep 01 16:58:54.396798 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d08cca5-7f3e-4d77-8133-ea8ba80e9f0e req-abd06de6-6913-4219-8153-ab9174559e33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:54.398275 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2d08cca5-7f3e-4d77-8133-ea8ba80e9f0e req-abd06de6-6913-4219-8153-ab9174559e33 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd331d5b-40b1-4163-8537-7af4e56f1efd HTTP/1.1" status: 200 len: 859 time: 0.1708596 Sep 01 16:58:54.408115 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c3cd0fba-d75a-41eb-8383-c2a8cceaafad req-454650ca-a390-420c-a369-825a78dc1d90 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420351 Sep 01 16:58:54.413979 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['ecc1fde7-837e-4490-b1f8-93b04ddaab48'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 16:58:54.529647 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2d08cca5-7f3e-4d77-8133-ea8ba80e9f0e req-3ad64935-ec68-4030-9baf-e8a3103881cd service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=63606bb0-66bd-46d6-ba6c-55c6da830865&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0995729 Sep 01 16:58:54.530663 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8520b49-90d3-441e-9328-2daab31198f3 req-e03af50d-edc2-480a-9992-7ecd0e4d53f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:54.532034 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f8520b49-90d3-441e-9328-2daab31198f3 req-e03af50d-edc2-480a-9992-7ecd0e4d53f6 service neutron] 10.222.0.69 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4717002 Sep 01 16:58:54.705175 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f13b3082-8086-4c3b-9180-d34b453c320f req-46c11b32-370f-4ef8-a19b-79701ff20c9d service neutron] 10.222.0.69 "GET /v2.0/networks/4af50d67-ae76-48e9-804b-cf2e7dc7f714?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2904456 Sep 01 16:58:54.713272 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ec2658-cde9-48bd-a9e2-49c091549d8c req-e4fa2475-edc5-4bd4-b700-408591043914 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:54.714131 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-15ec2658-cde9-48bd-a9e2-49c091549d8c req-e4fa2475-edc5-4bd4-b700-408591043914 service neutron] 10.222.0.69 "GET /v2.0/networks?tenant_id=af7d370157f84ca198eb86180115a76f&shared=False HTTP/1.1" status: 200 len: 917 time: 0.3249886 Sep 01 16:58:54.719603 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-1e25ed16-db62-4764-a598-0b485a45a5b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:54.721164 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-1e25ed16-db62-4764-a598-0b485a45a5b8 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=4199ca0b18374af7856c19238fc2fea1&device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 1096 time: 0.1251385 Sep 01 16:58:54.734720 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2d08cca5-7f3e-4d77-8133-ea8ba80e9f0e req-a0f0b329-4004-4ece-b32d-cfe38d59aa32 service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1901751 Sep 01 16:58:54.834684 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-ae819f49-465f-43e8-a7e7-b625606784c8 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5e47292e-406f-4ed9-9215-3dcfba5fcde4 HTTP/1.1" status: 200 len: 217 time: 0.0901535 Sep 01 16:58:54.883693 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:54.954959 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-ddf80e75-c252-433a-8165-6ba95bd4d55a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:54.956503 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-ddf80e75-c252-433a-8165-6ba95bd4d55a service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd331d5b-40b1-4163-8537-7af4e56f1efd HTTP/1.1" status: 200 len: 859 time: 0.0801027 Sep 01 16:58:55.013430 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-39a58427-b54f-4a7e-bce9-3e6abfbb3b54 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=63606bb0-66bd-46d6-ba6c-55c6da830865&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0417423 Sep 01 16:58:55.014675 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ec2658-cde9-48bd-a9e2-49c091549d8c req-5d6a9313-a6b7-40d1-ad55-52d71ea47e07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:55.016172 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-15ec2658-cde9-48bd-a9e2-49c091549d8c req-5d6a9313-a6b7-40d1-ad55-52d71ea47e07 service neutron] 10.222.0.69 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2805851 Sep 01 16:58:55.058844 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35fba9d4-342f-4842-80c9-49e64530d341 req-1227b219-467a-41d1-bab7-8730dfdadc64 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:55.067548 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-35fba9d4-342f-4842-80c9-49e64530d341 req-1227b219-467a-41d1-bab7-8730dfdadc64 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 943 time: 0.1566122 Sep 01 16:58:55.105629 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2d08cca5-7f3e-4d77-8133-ea8ba80e9f0e req-3556dcb6-4b07-4832-9325-f78b94f3d553 service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3520277 Sep 01 16:58:55.144683 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-35fba9d4-342f-4842-80c9-49e64530d341 req-6c9259f5-72f0-467f-b14a-21a97cace8f5 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0711858 Sep 01 16:58:55.166222 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cc00877-1fda-4a14-8733-7830a8ca4d82 req-9c7c5605-331d-4ed2-a64d-ef66de023216 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:55.168280 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-77a1e0bd-9f48-449d-9bac-999797b09e59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:55.170065 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-77a1e0bd-9f48-449d-9bac-999797b09e59 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 1096 time: 0.0757701 Sep 01 16:58:55.175254 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3cc00877-1fda-4a14-8733-7830a8ca4d82 req-9c7c5605-331d-4ed2-a64d-ef66de023216 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.1052024 Sep 01 16:58:55.176730 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-e5a9c936-de7f-47ad-bc5a-a681e0da2479 service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1402118 Sep 01 16:58:55.226920 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3cc00877-1fda-4a14-8733-7830a8ca4d82 req-096c86d8-2863-403c-9ab8-b72208bdc487 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0500145 Sep 01 16:58:55.277337 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd010409-84cf-4b6e-b15f-187155938b09 req-b318f51d-0633-49fb-9bb9-84d0f94acb12 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:55.279101 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-dd010409-84cf-4b6e-b15f-187155938b09 req-b318f51d-0633-49fb-9bb9-84d0f94acb12 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 944 time: 0.0681250 Sep 01 16:58:55.321599 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-dd010409-84cf-4b6e-b15f-187155938b09 req-1fe02eaa-6e62-496f-9d04-92f8a687f4d1 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358365 Sep 01 16:58:55.432549 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-f605a768-ba23-4b14-8d88-0d80dc6a1876 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb HTTP/1.1" status: 200 len: 217 time: 0.2465854 Sep 01 16:58:55.514468 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206f71a7-bb76-4c4b-a60a-ab1bc1a6b9fc req-c1ae731f-53fb-4324-8b69-3d5cf476a2b3 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:55.516169 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-206f71a7-bb76-4c4b-a60a-ab1bc1a6b9fc req-c1ae731f-53fb-4324-8b69-3d5cf476a2b3 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 944 time: 0.0529151 Sep 01 16:58:55.532301 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-ee116b55-9776-4199-bd7f-85b68367c608 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:55.533813 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-ee116b55-9776-4199-bd7f-85b68367c608 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=58fe425a-6b3e-47bd-b5c0-e68ea7782780 HTTP/1.1" status: 200 len: 855 time: 0.0744276 Sep 01 16:58:55.560107 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-206f71a7-bb76-4c4b-a60a-ab1bc1a6b9fc req-1e7dfadc-7aeb-4d77-a426-baebe3ba1ce6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0368531 Sep 01 16:58:55.576579 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4f62d599-4172-41e9-82aa-f6bcadea9beb req-2cf3343a-85bf-4336-89f6-4574388555e6 service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3895669 Sep 01 16:58:55.607218 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-64903067-4fab-48b4-b1bc-b356852b4989 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:55.608730 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-64903067-4fab-48b4-b1bc-b356852b4989 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2f7bfe5e-0012-467f-ad7f-aea2467233ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0632553 Sep 01 16:58:55.702053 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-c649b6a7-1387-4f4a-8d04-10a9d50d75e4 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854821 Sep 01 16:58:55.805640 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-002bfffa-20aa-495f-933e-069a04f8fdd6 req-0a556892-fc05-484d-b65e-7be52e8ccf04 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0952029 Sep 01 16:58:56.060098 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device ecc1fde7-837e-4490-b1f8-93b04ddaab48 up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:58:56.111895 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port ecc1fde7-837e-4490-b1f8-93b04ddaab48 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:58:56.115743 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port ecc1fde7-837e-4490-b1f8-93b04ddaab48 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:56.116135 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:56.200674 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:56.225880 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e18ee49e-3bbd-4cca-ae7e-0185ef0d225c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ecc1fde7-837e-4490-b1f8-93b04ddaab48'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 16:58:56.264357 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a48d8af-a857-4107-8238-5687ea384389 req-161c42cf-7f9f-43ec-9a2c-14bef9377f10 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:56.273848 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9a48d8af-a857-4107-8238-5687ea384389 req-161c42cf-7f9f-43ec-9a2c-14bef9377f10 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 943 time: 0.0627973 Sep 01 16:58:56.323229 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port ecc1fde7-837e-4490-b1f8-93b04ddaab48, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=ecc1fde7-837e-4490-b1f8-93b04ddaab48,segment=NetworkSegment(2785b39f-9a72-4d03-a737-382dced1c97a),segment_id=2785b39f-9a72-4d03-a737-382dced1c97a)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:58:56.326684 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9a48d8af-a857-4107-8238-5687ea384389 req-12364e12-0039-443e-a69a-37a485c901f0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515754 Sep 01 16:58:56.331536 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:56.332488 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 3890e11d-5295-488a-9033-9814bb94bf69 up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:58:56.442453 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=ecc1fde7-837e-4490-b1f8-93b04ddaab48,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:56.456093 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1608176d-1ad1-4ecb-a34e-2d0e81c5c959 req-c44d7f5d-c8fe-40ff-8a22-3e26140dd2b5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:56.461472 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:56.463976 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port 3890e11d-5295-488a-9033-9814bb94bf69 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:58:56.468313 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1608176d-1ad1-4ecb-a34e-2d0e81c5c959 req-c44d7f5d-c8fe-40ff-8a22-3e26140dd2b5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.1258981 Sep 01 16:58:56.471445 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port 3890e11d-5295-488a-9033-9814bb94bf69 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:58:56.472449 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:56.510522 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11313333-4885-4f84-8406-2986c7a759a2" -d '{"events": [{"server_uuid": "e18ee49e-3bbd-4cca-ae7e-0185ef0d225c", "name": "network-vif-plugged", "status": "completed", "tag": "ecc1fde7-837e-4490-b1f8-93b04ddaab48"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 16:58:56.535023 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1608176d-1ad1-4ecb-a34e-2d0e81c5c959 req-b666a144-8310-47f6-bdc6-aa1e69aec586 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0654261 Sep 01 16:58:56.539074 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:56.557563 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1815efef-7c68-45c1-9b08-480eacc9adcd req-0a94d908-40a3-47b4-b524-ce2f57e7225f tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:56.557563 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1815efef-7c68-45c1-9b08-480eacc9adcd req-0a94d908-40a3-47b4-b524-ce2f57e7225f tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 945 time: 0.0846004 Sep 01 16:58:56.580355 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:56.608468 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1815efef-7c68-45c1-9b08-480eacc9adcd req-17e03796-0399-47be-b857-30415069e7ec tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465884 Sep 01 16:58:56.618407 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 3890e11d-5295-488a-9033-9814bb94bf69, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=3890e11d-5295-488a-9033-9814bb94bf69,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:58:56.619212 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 51602) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:56.622812 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:56.679986 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=3890e11d-5295-488a-9033-9814bb94bf69,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:56.746177 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f041bf86-c54f-41d1-94cf-8b3792b4ec11 req-b9f87f74-4179-4a60-a4bb-d70cc9d900a6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:56.747801 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f041bf86-c54f-41d1-94cf-8b3792b4ec11 req-b9f87f74-4179-4a60-a4bb-d70cc9d900a6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 945 time: 0.0617070 Sep 01 16:58:56.753091 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-06471fb9-2e40-4be7-ab5d-8496754a43d6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:56.756831 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 16:58:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-58d25d99-65fc-4bfb-8fcf-47fd57d9315e x-openstack-request-id: req-58d25d99-65fc-4bfb-8fcf-47fd57d9315e {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 16:58:56.757127 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e18ee49e-3bbd-4cca-ae7e-0185ef0d225c", "name": "network-vif-plugged", "status": "completed", "tag": "ecc1fde7-837e-4490-b1f8-93b04ddaab48", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 16:58:56.757536 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-58d25d99-65fc-4bfb-8fcf-47fd57d9315e {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 16:58:56.758007 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e18ee49e-3bbd-4cca-ae7e-0185ef0d225c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ecc1fde7-837e-4490-b1f8-93b04ddaab48', 'code': 200} Sep 01 16:58:56.787343 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f041bf86-c54f-41d1-94cf-8b3792b4ec11 req-719575b3-62f7-45c9-b2ca-a9b16819d488 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331066 Sep 01 16:58:56.844740 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-06471fb9-2e40-4be7-ab5d-8496754a43d6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:56.848629 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-06471fb9-2e40-4be7-ab5d-8496754a43d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:56.887879 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-06471fb9-2e40-4be7-ab5d-8496754a43d6 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=f2022da903c54e728c8e0b4249354488&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2674701 Sep 01 16:58:56.889797 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06471fb9-2e40-4be7-ab5d-8496754a43d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9dec169b-1243-4bee-b30d-496ab7eb7ca2,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:56.890759 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 51612) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:56.951126 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a399bb41-1852-4f05-a73d-0b493265077f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:56.971974 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a399bb41-1852-4f05-a73d-0b493265077f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:57.021696 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a399bb41-1852-4f05-a73d-0b493265077f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:57.024315 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a399bb41-1852-4f05-a73d-0b493265077f admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:57.025833 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-a399bb41-1852-4f05-a73d-0b493265077f admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/9dec169b-1243-4bee-b30d-496ab7eb7ca2 HTTP/1.1" status: 204 len: 168 time: 0.1336803 Sep 01 16:58:57.033890 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a399bb41-1852-4f05-a73d-0b493265077f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9dec169b-1243-4bee-b30d-496ab7eb7ca2,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:57.318722 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 51638) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:57.332798 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ed120689-f46e-46e1-8d63-df6c81949090 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:57.458954 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ed120689-f46e-46e1-8d63-df6c81949090 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:57.463684 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ed120689-f46e-46e1-8d63-df6c81949090 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:57.478878 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3d0c2b3-6b43-4b07-bb86-9eacae274db0 req-1b0674b9-b9ed-4ad1-8769-8b6b559dce9e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:57.481285 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e3d0c2b3-6b43-4b07-bb86-9eacae274db0 req-1b0674b9-b9ed-4ad1-8769-8b6b559dce9e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 943 time: 0.0884304 Sep 01 16:58:57.533783 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-ed120689-f46e-46e1-8d63-df6c81949090 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=d79e9c9f5c8c4abc8ef5f8c1d5a9da2d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2116902 Sep 01 16:58:57.534003 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed120689-f46e-46e1-8d63-df6c81949090 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48d540ee-f586-45d8-b7dc-f9537cc98f47,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:57.534320 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 51644) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:58:57.558257 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e3d0c2b3-6b43-4b07-bb86-9eacae274db0 req-2f01bf0b-f820-4efb-8179-6ab1cb6db72e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0594959 Sep 01 16:58:57.603859 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f37c515b-7201-419c-b182-2e4027b41470 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:57.630493 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f37c515b-7201-419c-b182-2e4027b41470 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:57.680806 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b96349-dd77-40c8-aca9-4d14d7ffbdc7 req-ae4bd5b8-bdad-47d1-9cf0-254095a91888 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:57.689862 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-10b96349-dd77-40c8-aca9-4d14d7ffbdc7 req-ae4bd5b8-bdad-47d1-9cf0-254095a91888 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0751476 Sep 01 16:58:57.690516 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f37c515b-7201-419c-b182-2e4027b41470 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:57.695090 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f37c515b-7201-419c-b182-2e4027b41470 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:57.698777 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-f37c515b-7201-419c-b182-2e4027b41470 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/48d540ee-f586-45d8-b7dc-f9537cc98f47 HTTP/1.1" status: 204 len: 168 time: 0.1611104 Sep 01 16:58:57.704928 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f37c515b-7201-419c-b182-2e4027b41470 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48d540ee-f586-45d8-b7dc-f9537cc98f47,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:57.756370 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-10b96349-dd77-40c8-aca9-4d14d7ffbdc7 req-8b590236-949c-4efe-9d10-8edaf44bf9d2 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0656104 Sep 01 16:58:57.765117 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae5fd211-665c-4008-a832-3846edd10b18 req-1ae84554-6721-489a-889d-2684f8b8be42 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:57.766102 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ae5fd211-665c-4008-a832-3846edd10b18 req-1ae84554-6721-489a-889d-2684f8b8be42 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 945 time: 0.0734365 Sep 01 16:58:57.811090 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ae5fd211-665c-4008-a832-3846edd10b18 req-5d3c5469-4dad-4275-9762-dde17a2f39fb tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362518 Sep 01 16:58:57.912881 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c87a6f-a2d8-4c10-91ba-5a4ea18a5cdd req-93d53f16-62f1-4940-9169-ff975040f467 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:57.914390 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-28c87a6f-a2d8-4c10-91ba-5a4ea18a5cdd req-93d53f16-62f1-4940-9169-ff975040f467 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 945 time: 0.0524533 Sep 01 16:58:57.953227 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-28c87a6f-a2d8-4c10-91ba-5a4ea18a5cdd req-2b45ceae-9f48-4fce-aa87-f665b58f29d1 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324113 Sep 01 16:58:58.543582 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device e3d13334-c7d0-4f40-a25b-5c27c5f90c65 details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 16:58:58.676159 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port e3d13334-c7d0-4f40-a25b-5c27c5f90c65, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=e3d13334-c7d0-4f40-a25b-5c27c5f90c65,segment=NetworkSegment(9dfcf32c-db95-455a-ac7a-283312e9c7a0),segment_id=9dfcf32c-db95-455a-ac7a-283312e9c7a0)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:58:58.685436 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7635ab47-6701-4f40-9e16-98ca81689028 req-64a62c98-75e1-4346-a681-b3e07609132c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:58.693464 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7635ab47-6701-4f40-9e16-98ca81689028 req-64a62c98-75e1-4346-a681-b3e07609132c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 943 time: 0.0584900 Sep 01 16:58:58.699959 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'e3d13334-c7d0-4f40-a25b-5c27c5f90c65', 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865', 'port_id': 'e3d13334-c7d0-4f40-a25b-5c27c5f90c65', 'mac_address': 'fa:16:3e:72:79:b4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 506, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fd331d5b-40b1-4163-8537-7af4e56f1efd', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 16:58:58.750729 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7635ab47-6701-4f40-9e16-98ca81689028 req-e0f97f6d-4820-434b-9ab6-781c3d2b4a7c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479319 Sep 01 16:58:58.759557 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1bb80ba2-8b84-49d5-b868-889e3b7b8630', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3890e11d-5295-488a-9033-9814bb94bf69'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 16:58:58.762468 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-351aec55-2b0c-4f39-827d-d0582ef9f6db" -d '{"events": [{"server_uuid": "1bb80ba2-8b84-49d5-b868-889e3b7b8630", "name": "network-vif-plugged", "status": "completed", "tag": "3890e11d-5295-488a-9033-9814bb94bf69"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 16:58:58.767365 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:58.784252 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e3d13334-c7d0-4f40-a25b-5c27c5f90c65 {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 16:58:58.804196 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 16:58:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd929302-6fae-4b66-ab3e-9676635d1577 x-openstack-request-id: req-bd929302-6fae-4b66-ab3e-9676635d1577 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 16:58:58.804552 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1bb80ba2-8b84-49d5-b868-889e3b7b8630", "name": "network-vif-plugged", "status": "completed", "tag": "3890e11d-5295-488a-9033-9814bb94bf69", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 16:58:58.804699 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-bd929302-6fae-4b66-ab3e-9676635d1577 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 16:58:58.805258 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1bb80ba2-8b84-49d5-b868-889e3b7b8630', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3890e11d-5295-488a-9033-9814bb94bf69', 'code': 200} Sep 01 16:58:58.809231 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port e3d13334-c7d0-4f40-a25b-5c27c5f90c65, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=e3d13334-c7d0-4f40-a25b-5c27c5f90c65,segment=NetworkSegment(9dfcf32c-db95-455a-ac7a-283312e9c7a0),segment_id=9dfcf32c-db95-455a-ac7a-283312e9c7a0)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:58:58.813490 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:58.904915 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=e3d13334-c7d0-4f40-a25b-5c27c5f90c65,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:58:58.966699 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9ccb96b-aab1-4591-8215-33a8b07a5ec4 req-52176d5a-7044-410f-85c8-dc88aa3db498 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:58.968219 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b9ccb96b-aab1-4591-8215-33a8b07a5ec4 req-52176d5a-7044-410f-85c8-dc88aa3db498 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0978098 Sep 01 16:58:59.007886 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-987a7bbb-8db0-4c90-9281-ac9c3f1fb0b1 req-cdbcbbcf-802d-48d8-93ab-57e91a77bf0b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:59.009341 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-987a7bbb-8db0-4c90-9281-ac9c3f1fb0b1 req-cdbcbbcf-802d-48d8-93ab-57e91a77bf0b tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 945 time: 0.0945721 Sep 01 16:58:59.040598 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b9ccb96b-aab1-4591-8215-33a8b07a5ec4 req-b2dc3bd5-a59f-473c-8904-2a50361a2bc7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0631082 Sep 01 16:58:59.066396 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-987a7bbb-8db0-4c90-9281-ac9c3f1fb0b1 req-630fbb44-7894-478e-b51b-a54fb6296405 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499945 Sep 01 16:58:59.161827 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ca6de89-a37c-4d93-9f25-a80d5f4c7075 req-d6e3b0b7-2d47-49fd-97b5-be9b7cfa9977 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:59.163311 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2ca6de89-a37c-4d93-9f25-a80d5f4c7075 req-d6e3b0b7-2d47-49fd-97b5-be9b7cfa9977 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 945 time: 0.0490255 Sep 01 16:58:59.200675 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2ca6de89-a37c-4d93-9f25-a80d5f4c7075 req-3993171c-33de-45bf-b0e1-204803235226 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314181 Sep 01 16:58:59.762606 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48acb2e3-487e-458f-a750-3c9f132c1c3d req-89ed53e3-8dce-4642-98f5-bbb1fa901c68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:59.764122 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-48acb2e3-487e-458f-a750-3c9f132c1c3d req-89ed53e3-8dce-4642-98f5-bbb1fa901c68 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 1098 time: 0.1078849 Sep 01 16:58:59.770011 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef65a7bb-9728-48e6-adfd-d1300f3f6075 req-4dc0b09a-c6a8-4d5f-90d1-8bb23e661a61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:59.771395 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-ef65a7bb-9728-48e6-adfd-d1300f3f6075 req-4dc0b09a-c6a8-4d5f-90d1-8bb23e661a61 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 1098 time: 0.0574725 Sep 01 16:58:59.796351 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['e3d13334-c7d0-4f40-a25b-5c27c5f90c65'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 16:58:59.805082 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-48acb2e3-487e-458f-a750-3c9f132c1c3d req-a4106f03-15ad-45e2-9074-8b5160bf6bc0 service neutron] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:59.808135 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-ef65a7bb-9728-48e6-adfd-d1300f3f6075 req-dde3acb8-1d15-4c37-b209-945b595b1256 service neutron] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:59.841737 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.db.api [req-ef65a7bb-9728-48e6-adfd-d1300f3f6075 req-dde3acb8-1d15-4c37-b209-945b595b1256 service neutron] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 01 16:58:59.841737 dv-cinder-799668-16-iscsi neutron-server[93835]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Sep 01 16:58:59.841737 dv-cinder-799668-16-iscsi neutron-server[93835]: [parameters: {'project_id': 'fb5daef7028d4b1098a7d9a837e650f6', 'id': '0a13ed80-c8e2-4d63-82f5-95e261d9c057', 'expiration': datetime.datetime(2021, 9, 1, 17, 0, 59, 837256)}] Sep 01 16:58:59.841737 dv-cinder-799668-16-iscsi neutron-server[93835]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=93835) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Sep 01 16:58:59.843274 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG oslo_db.api [req-ef65a7bb-9728-48e6-adfd-d1300f3f6075 req-dde3acb8-1d15-4c37-b209-945b595b1256 service neutron] Performing DB retry for function neutron.db.securitygroups_db.SecurityGroupDbMixin.create_security_group {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Sep 01 16:58:59.856839 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d44fd2d2-55e9-458a-ad3e-44a994bbb27e req-209b18c3-1cd8-47b4-bdba-6490a08df625 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:58:59.858373 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d44fd2d2-55e9-458a-ad3e-44a994bbb27e req-209b18c3-1cd8-47b4-bdba-6490a08df625 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 943 time: 0.0519388 Sep 01 16:58:59.897296 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d44fd2d2-55e9-458a-ad3e-44a994bbb27e req-c6613d39-9bce-4bfe-9adc-fb113d191489 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329585 Sep 01 16:58:59.939452 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-48acb2e3-487e-458f-a750-3c9f132c1c3d req-a4106f03-15ad-45e2-9074-8b5160bf6bc0 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:59.943597 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-48acb2e3-487e-458f-a750-3c9f132c1c3d req-a4106f03-15ad-45e2-9074-8b5160bf6bc0 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:58:59.980784 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-48acb2e3-487e-458f-a750-3c9f132c1c3d req-a4106f03-15ad-45e2-9074-8b5160bf6bc0 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1994786 Sep 01 16:58:59.985526 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4106f03-15ad-45e2-9074-8b5160bf6bc0 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=06805ea6-5f36-4597-876a-57c0e577b25c,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:00.090971 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device f3cd3382-a1bb-4f12-b1b1-64bd000296fb details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 16:59:00.237939 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port f3cd3382-a1bb-4f12-b1b1-64bd000296fb, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:59:00.251691 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'port_id': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'mac_address': 'fa:16:3e:95:9e:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 544, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 16:59:00.257994 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c98728f7-2d68-4224-97d3-52a3f74f83ca req-3423564a-f637-43c5-a94f-2347b632bd68 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:00.259588 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c98728f7-2d68-4224-97d3-52a3f74f83ca req-3423564a-f637-43c5-a94f-2347b632bd68 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 945 time: 0.1028934 Sep 01 16:59:00.267304 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9ce0a26-56df-4ea1-ac19-48633370a440 req-c040c7be-290b-4181-92ee-01b3635215fd tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:00.268827 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e9ce0a26-56df-4ea1-ac19-48633370a440 req-c040c7be-290b-4181-92ee-01b3635215fd tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.1219893 Sep 01 16:59:00.315728 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:00.330931 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c98728f7-2d68-4224-97d3-52a3f74f83ca req-89fae3d2-8f89-4f18-a5d0-cdefc5676cd9 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0610166 Sep 01 16:59:00.332069 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f3cd3382-a1bb-4f12-b1b1-64bd000296fb {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 16:59:00.344546 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-ef65a7bb-9728-48e6-adfd-d1300f3f6075 req-dde3acb8-1d15-4c37-b209-945b595b1256 service neutron] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:00.378308 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e9ce0a26-56df-4ea1-ac19-48633370a440 req-3a20408a-7e76-4e0d-b730-8459e844b727 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0872040 Sep 01 16:59:00.385880 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port f3cd3382-a1bb-4f12-b1b1-64bd000296fb, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:59:00.394027 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:00.397028 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 5e47292e-406f-4ed9-9215-3dcfba5fcde4 details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 16:59:00.463642 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-ef65a7bb-9728-48e6-adfd-d1300f3f6075 req-dde3acb8-1d15-4c37-b209-945b595b1256 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6815844 Sep 01 16:59:00.496445 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35c06e89-2f70-4eed-b4b4-d66e49e4bcbb req-3dadb37a-f8af-4f42-a8f5-a458232ebb2c tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:00.501966 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-35c06e89-2f70-4eed-b4b4-d66e49e4bcbb req-3dadb37a-f8af-4f42-a8f5-a458232ebb2c tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 945 time: 0.0681059 Sep 01 16:59:00.548747 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-35c06e89-2f70-4eed-b4b4-d66e49e4bcbb req-d7190f1e-fdfc-4492-841c-8ef3c0c7af02 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426741 Sep 01 16:59:00.557623 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:00.580740 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 5e47292e-406f-4ed9-9215-3dcfba5fcde4, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=5e47292e-406f-4ed9-9215-3dcfba5fcde4,segment=NetworkSegment(9dfcf32c-db95-455a-ac7a-283312e9c7a0),segment_id=9dfcf32c-db95-455a-ac7a-283312e9c7a0)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:59:00.594025 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': '5e47292e-406f-4ed9-9215-3dcfba5fcde4', 'network_id': '63606bb0-66bd-46d6-ba6c-55c6da830865', 'port_id': '5e47292e-406f-4ed9-9215-3dcfba5fcde4', 'mac_address': 'fa:16:3e:b5:05:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 506, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fd331d5b-40b1-4163-8537-7af4e56f1efd', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 16:59:00.633428 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:00.649794 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5e47292e-406f-4ed9-9215-3dcfba5fcde4 {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 16:59:00.673837 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 5e47292e-406f-4ed9-9215-3dcfba5fcde4, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=5e47292e-406f-4ed9-9215-3dcfba5fcde4,segment=NetworkSegment(9dfcf32c-db95-455a-ac7a-283312e9c7a0),segment_id=9dfcf32c-db95-455a-ac7a-283312e9c7a0)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:59:00.680817 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:00.732325 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=5e47292e-406f-4ed9-9215-3dcfba5fcde4,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:00.832396 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 51766) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:00.910089 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 51774) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:00.976729 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['5e47292e-406f-4ed9-9215-3dcfba5fcde4'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 16:59:00.983473 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['f3cd3382-a1bb-4f12-b1b1-64bd000296fb'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 16:59:01.024089 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2df7db5a-7a09-4803-a5e0-8edb1a3b4cdb admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.033126 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87dce2ee-0f5a-46ce-94c3-5d394ce4bab5 req-e7477ba5-e701-4fa3-99d7-ef8848059ddf tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:01.035484 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-87dce2ee-0f5a-46ce-94c3-5d394ce4bab5 req-e7477ba5-e701-4fa3-99d7-ef8848059ddf tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 944 time: 0.0624256 Sep 01 16:59:01.053165 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24a7c10b-98b5-4f45-a87b-e8ddc4f900ae admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.085806 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-87dce2ee-0f5a-46ce-94c3-5d394ce4bab5 req-550df88e-21e9-4e12-8896-d41f3975ea3e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405390 Sep 01 16:59:01.147701 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2df7db5a-7a09-4803-a5e0-8edb1a3b4cdb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.154029 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2df7db5a-7a09-4803-a5e0-8edb1a3b4cdb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.208374 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-2df7db5a-7a09-4803-a5e0-8edb1a3b4cdb admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=29d882e2265242ddb559f00a2e391598&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3748713 Sep 01 16:59:01.210890 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 51784) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:01.215187 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2df7db5a-7a09-4803-a5e0-8edb1a3b4cdb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=68b447c1-085f-431e-9a41-9f50a92f2291,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:01.289909 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c6160322-d09e-492a-a5e6-4687a8386355 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.304586 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24a7c10b-98b5-4f45-a87b-e8ddc4f900ae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.308978 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24a7c10b-98b5-4f45-a87b-e8ddc4f900ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.311967 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c6160322-d09e-492a-a5e6-4687a8386355 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.349296 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-24a7c10b-98b5-4f45-a87b-e8ddc4f900ae admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=3ffd80d6a90645bf8159d4c883cce9ae&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4381349 Sep 01 16:59:01.350335 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24a7c10b-98b5-4f45-a87b-e8ddc4f900ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=71c97a6c-b3db-4038-a4ff-4a0858ef2609,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:01.352043 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 51788) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:01.374089 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c6160322-d09e-492a-a5e6-4687a8386355 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.376760 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c6160322-d09e-492a-a5e6-4687a8386355 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.377935 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c6160322-d09e-492a-a5e6-4687a8386355 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/68b447c1-085f-431e-9a41-9f50a92f2291 HTTP/1.1" status: 204 len: 168 time: 0.1659155 Sep 01 16:59:01.419437 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5bb90ebc-63cb-4c24-a0a0-81060e674dc7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.422421 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6160322-d09e-492a-a5e6-4687a8386355 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=68b447c1-085f-431e-9a41-9f50a92f2291,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:01.462797 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5bb90ebc-63cb-4c24-a0a0-81060e674dc7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.492640 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 51798) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:01.571334 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa1fc62-3e7b-4ac0-8060-484a45a2c57a req-ea9b0b15-4f9a-419f-a5f6-bd11fc0d5708 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:01.572893 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7fa1fc62-3e7b-4ac0-8060-484a45a2c57a req-ea9b0b15-4f9a-419f-a5f6-bd11fc0d5708 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 945 time: 0.1142337 Sep 01 16:59:01.582830 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67730966-37b1-4498-9ba8-0e38ea322be7 req-66c8bce5-efd8-4267-b13d-2d664d7a7b3f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:01.590042 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-67730966-37b1-4498-9ba8-0e38ea322be7 req-66c8bce5-efd8-4267-b13d-2d664d7a7b3f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 944 time: 0.1136911 Sep 01 16:59:01.655381 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5bb90ebc-63cb-4c24-a0a0-81060e674dc7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.657872 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5bb90ebc-63cb-4c24-a0a0-81060e674dc7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.661295 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-5bb90ebc-63cb-4c24-a0a0-81060e674dc7 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/71c97a6c-b3db-4038-a4ff-4a0858ef2609 HTTP/1.1" status: 204 len: 168 time: 0.3058200 Sep 01 16:59:01.674948 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7fa1fc62-3e7b-4ac0-8060-484a45a2c57a req-487003d5-00e7-4c29-9274-f8c57e1e7992 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0761850 Sep 01 16:59:01.681927 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-67730966-37b1-4498-9ba8-0e38ea322be7 req-96c58e69-9dda-48c4-99f0-b7f0441ae60e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0907893 Sep 01 16:59:01.683936 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bb90ebc-63cb-4c24-a0a0-81060e674dc7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=71c97a6c-b3db-4038-a4ff-4a0858ef2609,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:01.763472 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3c7b596f-9be7-493b-a1aa-d379c00a5de7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.784982 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 51808) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:01.803368 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76df5f71-27c2-4851-a551-2406fd40e9ac req-6b31583e-31ad-4839-9850-8d463c9765ac tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:01.804968 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-76df5f71-27c2-4851-a551-2406fd40e9ac req-6b31583e-31ad-4839-9850-8d463c9765ac tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 945 time: 0.0557115 Sep 01 16:59:01.808501 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2310daa5-ed22-407a-93ab-eb26d6585e70 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.845862 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-76df5f71-27c2-4851-a551-2406fd40e9ac req-b8e04abd-6aa6-4897-b775-078050464af8 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342822 Sep 01 16:59:01.899612 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3c7b596f-9be7-493b-a1aa-d379c00a5de7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.906621 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3c7b596f-9be7-493b-a1aa-d379c00a5de7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:01.958414 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-3c7b596f-9be7-493b-a1aa-d379c00a5de7 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=f1760ccce2f24118b37af89698976d5c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4644947 Sep 01 16:59:01.961564 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 51814) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:01.967078 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c7b596f-9be7-493b-a1aa-d379c00a5de7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d3f3acb2-e939-42a0-a444-87720572e25a,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:02.034737 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1686eeb1-1d0a-4ed6-a5d9-57a2bc3449a8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.082058 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1686eeb1-1d0a-4ed6-a5d9-57a2bc3449a8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.091963 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2310daa5-ed22-407a-93ab-eb26d6585e70 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.099486 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device e3d13334-c7d0-4f40-a25b-5c27c5f90c65 up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:02.102735 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2310daa5-ed22-407a-93ab-eb26d6585e70 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.166139 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-2310daa5-ed22-407a-93ab-eb26d6585e70 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=7023854091774ead8079fd8d2a93183d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3770151 Sep 01 16:59:02.180901 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port e3d13334-c7d0-4f40-a25b-5c27c5f90c65 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:59:02.181376 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 51824) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:02.191711 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port e3d13334-c7d0-4f40-a25b-5c27c5f90c65 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:02.197516 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.206245 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 51826) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:02.233667 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2310daa5-ed22-407a-93ab-eb26d6585e70 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d8e19bb-8c2a-4cca-8f26-939765292e53,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:02.262370 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a190975b-9e0f-4682-b792-6bcc92fc47a4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.269960 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e60226c5-4dc2-4bf1-8dd4-07ba04afc88e admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.285719 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1686eeb1-1d0a-4ed6-a5d9-57a2bc3449a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.288756 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1686eeb1-1d0a-4ed6-a5d9-57a2bc3449a8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.289944 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-1686eeb1-1d0a-4ed6-a5d9-57a2bc3449a8 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/d3f3acb2-e939-42a0-a444-87720572e25a HTTP/1.1" status: 204 len: 168 time: 0.3268201 Sep 01 16:59:02.290070 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a190975b-9e0f-4682-b792-6bcc92fc47a4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.334397 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1686eeb1-1d0a-4ed6-a5d9-57a2bc3449a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3f3acb2-e939-42a0-a444-87720572e25a,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:02.378058 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f1a151e-db31-4086-a8e1-5067c4269e2e req-f95a14d9-8c5e-479c-b13a-6d6912fe5343 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:02.380188 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4f1a151e-db31-4086-a8e1-5067c4269e2e req-f95a14d9-8c5e-479c-b13a-6d6912fe5343 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 944 time: 0.0964508 Sep 01 16:59:02.405079 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a190975b-9e0f-4682-b792-6bcc92fc47a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.410219 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a190975b-9e0f-4682-b792-6bcc92fc47a4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.415233 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-a190975b-9e0f-4682-b792-6bcc92fc47a4 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/9d8e19bb-8c2a-4cca-8f26-939765292e53 HTTP/1.1" status: 204 len: 168 time: 0.2327368 Sep 01 16:59:02.425720 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a190975b-9e0f-4682-b792-6bcc92fc47a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d8e19bb-8c2a-4cca-8f26-939765292e53,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:02.456731 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.472469 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4f1a151e-db31-4086-a8e1-5067c4269e2e req-15487591-2e82-4d32-b2ac-615337b23f58 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683541 Sep 01 16:59:02.503048 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port e3d13334-c7d0-4f40-a25b-5c27c5f90c65, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=e3d13334-c7d0-4f40-a25b-5c27c5f90c65,segment=NetworkSegment(9dfcf32c-db95-455a-ac7a-283312e9c7a0),segment_id=9dfcf32c-db95-455a-ac7a-283312e9c7a0)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:59:02.504189 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84bd0410-fb41-4744-970f-c2402a7faf77', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e3d13334-c7d0-4f40-a25b-5c27c5f90c65'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 16:59:02.507275 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e04f040b-fd37-44e3-a578-e3e4323c597f" -d '{"events": [{"server_uuid": "84bd0410-fb41-4744-970f-c2402a7faf77", "name": "network-vif-plugged", "status": "completed", "tag": "e3d13334-c7d0-4f40-a25b-5c27c5f90c65"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 16:59:02.511895 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.512847 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device f3cd3382-a1bb-4f12-b1b1-64bd000296fb up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:02.517115 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e60226c5-4dc2-4bf1-8dd4-07ba04afc88e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.522092 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e60226c5-4dc2-4bf1-8dd4-07ba04afc88e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.562111 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 16:59:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-43741497-cc99-4802-af7c-3c5d7b4f86ff x-openstack-request-id: req-43741497-cc99-4802-af7c-3c5d7b4f86ff {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 16:59:02.562639 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "84bd0410-fb41-4744-970f-c2402a7faf77", "name": "network-vif-plugged", "status": "completed", "tag": "e3d13334-c7d0-4f40-a25b-5c27c5f90c65", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 16:59:02.563063 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-43741497-cc99-4802-af7c-3c5d7b4f86ff {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 16:59:02.563590 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '84bd0410-fb41-4744-970f-c2402a7faf77', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e3d13334-c7d0-4f40-a25b-5c27c5f90c65', 'code': 200} Sep 01 16:59:02.575206 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 51840) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:02.578771 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-e60226c5-4dc2-4bf1-8dd4-07ba04afc88e admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=3390c504a4a3411eb80497689e045168&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3636310 Sep 01 16:59:02.583914 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e60226c5-4dc2-4bf1-8dd4-07ba04afc88e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5dac47a8-f561-4435-800d-8ba2264e0223,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:02.614071 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=e3d13334-c7d0-4f40-a25b-5c27c5f90c65,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:02.627795 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port f3cd3382-a1bb-4f12-b1b1-64bd000296fb completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:59:02.638788 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port f3cd3382-a1bb-4f12-b1b1-64bd000296fb triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:02.639325 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.650727 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4f5be942-a8a8-4dc3-9d60-67cd90d3bf10 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.678783 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4f5be942-a8a8-4dc3-9d60-67cd90d3bf10 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.753025 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.758085 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4f5be942-a8a8-4dc3-9d60-67cd90d3bf10 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.760620 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4f5be942-a8a8-4dc3-9d60-67cd90d3bf10 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.768699 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-4f5be942-a8a8-4dc3-9d60-67cd90d3bf10 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/5dac47a8-f561-4435-800d-8ba2264e0223 HTTP/1.1" status: 204 len: 168 time: 0.1922081 Sep 01 16:59:02.787337 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f5be942-a8a8-4dc3-9d60-67cd90d3bf10 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5dac47a8-f561-4435-800d-8ba2264e0223,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:02.795413 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port f3cd3382-a1bb-4f12-b1b1-64bd000296fb, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:59:02.809436 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.810246 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 5e47292e-406f-4ed9-9215-3dcfba5fcde4 up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:02.824762 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e155aa1b-37c1-47dd-8412-83c0e022b811 req-31f4c697-9e48-4859-86f2-a6c99f7dc5e6 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:02.826346 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e155aa1b-37c1-47dd-8412-83c0e022b811 req-31f4c697-9e48-4859-86f2-a6c99f7dc5e6 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 945 time: 0.0668716 Sep 01 16:59:02.889187 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:02.904795 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e155aa1b-37c1-47dd-8412-83c0e022b811 req-5b3214ac-ebc1-41cc-8fbd-ccaf7b5d826d tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709827 Sep 01 16:59:02.907678 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port 5e47292e-406f-4ed9-9215-3dcfba5fcde4 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:59:02.912220 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port 5e47292e-406f-4ed9-9215-3dcfba5fcde4 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:02.912738 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:02.948675 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4df29175-339b-4b38-8f42-e05d83868d31 req-1ea74a47-703e-40fe-ad18-f6cc43dc9d68 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:02.951146 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4df29175-339b-4b38-8f42-e05d83868d31 req-1ea74a47-703e-40fe-ad18-f6cc43dc9d68 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0695863 Sep 01 16:59:03.058746 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4df29175-339b-4b38-8f42-e05d83868d31 req-85a407a9-ad37-4846-a581-bb988544235e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0988667 Sep 01 16:59:03.066553 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:03.107295 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eca470d-7961-4aa1-9be7-a92f957dcc6c req-6180e889-c2a8-4f96-938c-2bc9c2e7f7d3 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:03.115663 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7eca470d-7961-4aa1-9be7-a92f957dcc6c req-6180e889-c2a8-4f96-938c-2bc9c2e7f7d3 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 945 time: 0.0857284 Sep 01 16:59:03.118836 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 5e47292e-406f-4ed9-9215-3dcfba5fcde4, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=5e47292e-406f-4ed9-9215-3dcfba5fcde4,segment=NetworkSegment(9dfcf32c-db95-455a-ac7a-283312e9c7a0),segment_id=9dfcf32c-db95-455a-ac7a-283312e9c7a0)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:59:03.125207 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:03.178990 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7eca470d-7961-4aa1-9be7-a92f957dcc6c req-8d0bd29e-1145-450c-ab02-b10c7638e1e3 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624437 Sep 01 16:59:03.196033 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=5e47292e-406f-4ed9-9215-3dcfba5fcde4,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:03.295839 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 51870) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:03.308015 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a15951d3-4920-4767-9363-e03eeab0b6db admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:03.454355 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a15951d3-4920-4767-9363-e03eeab0b6db admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:03.459463 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a15951d3-4920-4767-9363-e03eeab0b6db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:03.508544 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-a15951d3-4920-4767-9363-e03eeab0b6db admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=548bc30df7c147dd9710c5c324762ff4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2169366 Sep 01 16:59:03.508721 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a15951d3-4920-4767-9363-e03eeab0b6db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e768192-af57-414f-af2b-454b2822c6bd,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:03.512730 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 51884) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:03.637853 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-92ae6bdb-9965-4c49-97e7-536e4e374c93 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:03.669871 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-92ae6bdb-9965-4c49-97e7-536e4e374c93 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:03.678767 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4b0c60-788d-409b-a47e-fb24c3226dc2 req-76f52a95-9c5e-4802-ba55-190e6af0c5f2 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:03.679817 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5d4b0c60-788d-409b-a47e-fb24c3226dc2 req-76f52a95-9c5e-4802-ba55-190e6af0c5f2 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.1036756 Sep 01 16:59:03.760894 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5d4b0c60-788d-409b-a47e-fb24c3226dc2 req-aadc0222-1641-4e0f-ae7e-f099b52607ae tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712874 Sep 01 16:59:03.777357 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-92ae6bdb-9965-4c49-97e7-536e4e374c93 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:03.779979 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-92ae6bdb-9965-4c49-97e7-536e4e374c93 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:03.781134 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-92ae6bdb-9965-4c49-97e7-536e4e374c93 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/6e768192-af57-414f-af2b-454b2822c6bd HTTP/1.1" status: 204 len: 168 time: 0.2664206 Sep 01 16:59:03.790284 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92ae6bdb-9965-4c49-97e7-536e4e374c93 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e768192-af57-414f-af2b-454b2822c6bd,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:04.201432 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63313397-38d3-4c8f-a991-806aa854ee86 req-5c822b62-3c71-4e84-8c1d-d875a4bc26b0 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:04.202979 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-63313397-38d3-4c8f-a991-806aa854ee86 req-5c822b62-3c71-4e84-8c1d-d875a4bc26b0 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0638173 Sep 01 16:59:04.247662 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-63313397-38d3-4c8f-a991-806aa854ee86 req-3d6b18ce-8500-4dbe-b156-059f432fdcbd tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0360115 Sep 01 16:59:04.564893 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb'}, {'server_uuid': '891d0bc6-0f97-45d5-a4d2-d329fbe22fd6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5e47292e-406f-4ed9-9215-3dcfba5fcde4'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 16:59:04.568049 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f2c1d2fe-a7e8-4025-a61b-05ff08161106" -d '{"events": [{"server_uuid": "0678fbe1-e92f-49b6-93cd-5babcfc2de18", "name": "network-vif-plugged", "status": "completed", "tag": "f3cd3382-a1bb-4f12-b1b1-64bd000296fb"}, {"server_uuid": "891d0bc6-0f97-45d5-a4d2-d329fbe22fd6", "name": "network-vif-plugged", "status": "completed", "tag": "5e47292e-406f-4ed9-9215-3dcfba5fcde4"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 16:59:04.612075 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Wed, 01 Sep 2021 16:59:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d98562f-c434-4204-b558-24ce3918f180 x-openstack-request-id: req-4d98562f-c434-4204-b558-24ce3918f180 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 16:59:04.612628 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0678fbe1-e92f-49b6-93cd-5babcfc2de18", "name": "network-vif-plugged", "status": "completed", "tag": "f3cd3382-a1bb-4f12-b1b1-64bd000296fb", "code": 200}, {"server_uuid": "891d0bc6-0f97-45d5-a4d2-d329fbe22fd6", "name": "network-vif-plugged", "status": "completed", "tag": "5e47292e-406f-4ed9-9215-3dcfba5fcde4", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 16:59:04.612976 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-4d98562f-c434-4204-b558-24ce3918f180 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 16:59:04.613539 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'code': 200} Sep 01 16:59:04.613892 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '891d0bc6-0f97-45d5-a4d2-d329fbe22fd6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5e47292e-406f-4ed9-9215-3dcfba5fcde4', 'code': 200} Sep 01 16:59:04.888652 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76c2665-cd5d-4c2b-8ef4-9cb6f3864239 req-6c433f83-dfce-473c-a805-0fc1f258170d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:04.895709 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e76c2665-cd5d-4c2b-8ef4-9cb6f3864239 req-6c433f83-dfce-473c-a805-0fc1f258170d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0583575 Sep 01 16:59:04.933933 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e76c2665-cd5d-4c2b-8ef4-9cb6f3864239 req-9745a0c5-967a-45a6-9fd1-b25277c41dc9 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0364611 Sep 01 16:59:05.392185 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20bc5343-b38b-4b62-8919-8298323bc30c req-d1525b7e-f9ba-4c7e-9c98-512655c036d6 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:05.393890 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-20bc5343-b38b-4b62-8919-8298323bc30c req-d1525b7e-f9ba-4c7e-9c98-512655c036d6 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0605927 Sep 01 16:59:05.435020 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-20bc5343-b38b-4b62-8919-8298323bc30c req-40efd35f-bf8a-48bb-8d3b-d0f2661a42ae tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0351501 Sep 01 16:59:05.557738 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e4a5e4d-40f1-4e8c-8e2c-0332c11bc6a5 req-016d393a-ca3b-44d3-81b0-3663cf0f0fba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:05.560157 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-8e4a5e4d-40f1-4e8c-8e2c-0332c11bc6a5 req-016d393a-ca3b-44d3-81b0-3663cf0f0fba service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 1098 time: 0.0654204 Sep 01 16:59:05.583504 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:59:05.675825 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-8e4a5e4d-40f1-4e8c-8e2c-0332c11bc6a5 req-68c098f9-44d7-4737-85fc-c15fbc0b386c service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690491 Sep 01 16:59:06.028711 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4506d552-2e53-4385-bf20-c307db87b397 req-0b7d47ce-2d5a-4f3f-9953-4c1dd560a96a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:06.030345 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4506d552-2e53-4385-bf20-c307db87b397 req-0b7d47ce-2d5a-4f3f-9953-4c1dd560a96a service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 1098 time: 0.0641234 Sep 01 16:59:06.036355 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4477912-aa65-4c4c-a334-b97b0e849e51 req-302649c3-bbbf-4ff7-b8ce-745353611484 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:06.037832 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a4477912-aa65-4c4c-a334-b97b0e849e51 req-302649c3-bbbf-4ff7-b8ce-745353611484 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 1098 time: 0.0737262 Sep 01 16:59:06.064989 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32ba293b-8020-489c-a281-7773ffcb5432 req-ce56d563-629d-4f31-b690-92b9dc7ee7ca tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:06.067199 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-32ba293b-8020-489c-a281-7773ffcb5432 req-ce56d563-629d-4f31-b690-92b9dc7ee7ca tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0667450 Sep 01 16:59:06.095406 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4506d552-2e53-4385-bf20-c307db87b397 req-bbe8057a-ce8d-416f-aa0c-e3e21be27e1d service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0563684 Sep 01 16:59:06.096984 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a4477912-aa65-4c4c-a334-b97b0e849e51 req-77dc74a4-623b-43e3-95cf-16fb17ba2f0a service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502257 Sep 01 16:59:06.110235 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-32ba293b-8020-489c-a281-7773ffcb5432 req-a60763e5-ba2e-4910-8af1-9fe1f604ecf1 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0354965 Sep 01 16:59:06.554825 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84298dd2-648c-4e94-9c81-072be3df5342 req-98c38233-d8de-450d-9b38-80c859961fb2 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:06.556286 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-84298dd2-648c-4e94-9c81-072be3df5342 req-98c38233-d8de-450d-9b38-80c859961fb2 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0484645 Sep 01 16:59:06.595883 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-84298dd2-648c-4e94-9c81-072be3df5342 req-702ed9df-e3d8-4471-9ed0-48eca4dda66a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0335305 Sep 01 16:59:07.385078 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1ac08cf-2b92-41a8-91a4-2163e40384bf req-a4ca5446-61f6-4204-860c-8f7f0d382149 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:07.387486 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d1ac08cf-2b92-41a8-91a4-2163e40384bf req-a4ca5446-61f6-4204-860c-8f7f0d382149 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0645390 Sep 01 16:59:07.467120 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d1ac08cf-2b92-41a8-91a4-2163e40384bf req-d57d7cff-67f3-46c5-9fc8-fb8912102fa4 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694764 Sep 01 16:59:07.721413 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7317f317-822e-45d9-910b-f7d7cdb5f194 req-0c804503-657d-473e-9087-d5e6d722cc2c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:07.722911 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7317f317-822e-45d9-910b-f7d7cdb5f194 req-0c804503-657d-473e-9087-d5e6d722cc2c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0513804 Sep 01 16:59:07.760835 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7317f317-822e-45d9-910b-f7d7cdb5f194 req-e23b6fd2-8d3d-4656-b515-6c2d0d2e17e2 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0318255 Sep 01 16:59:07.878217 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a22062-7254-445f-82c1-9dae576f08e7 req-6f77bac0-5ba4-4e59-a5b6-458168cfe7d9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:07.879845 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f5a22062-7254-445f-82c1-9dae576f08e7 req-6f77bac0-5ba4-4e59-a5b6-458168cfe7d9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0510349 Sep 01 16:59:07.890345 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52098) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:07.894480 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-5489450d-8bf9-4b41-ad20-bec3e03d9f30 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Request body: {'floatingip': {'port_id': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:59:07.985699 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5489450d-8bf9-4b41-ad20-bec3e03d9f30 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for floatingip, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:08.437809 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52118) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:08.636208 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a41f960-12f5-4d22-8b8c-b8480741246b admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:08.763245 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33cf56ca-0045-4b94-96f6-28894e9c4c1a req-b623a919-d10f-4fe5-9c14-ba36fc6d8c83 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:08.764763 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-33cf56ca-0045-4b94-96f6-28894e9c4c1a req-b623a919-d10f-4fe5-9c14-ba36fc6d8c83 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.2082598 Sep 01 16:59:08.932680 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-33cf56ca-0045-4b94-96f6-28894e9c4c1a req-9ed83ed6-8144-41f9-9cd1-77c9104433bd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1462061 Sep 01 16:59:08.963493 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5489450d-8bf9-4b41-ad20-bec3e03d9f30 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for floatingip, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:08.970062 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5489450d-8bf9-4b41-ad20-bec3e03d9f30 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.067825 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a41f960-12f5-4d22-8b8c-b8480741246b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.072665 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a41f960-12f5-4d22-8b8c-b8480741246b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.122124 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-2a41f960-12f5-4d22-8b8c-b8480741246b admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=447832450e434123987fd6b17e32c6aa&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6833017 Sep 01 16:59:09.124776 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 52142) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:09.126115 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.l3_db [None req-5489450d-8bf9-4b41-ad20-bec3e03d9f30 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Floating IP 8d24ba55-ba66-4fe7-84c7-fbf7569b66f7 associated. External IP: 172.27.1.60, port: f3cd3382-a1bb-4f12-b1b1-64bd000296fb. Sep 01 16:59:09.130058 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a41f960-12f5-4d22-8b8c-b8480741246b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=949da0ca-07b2-4c30-80f7-afb4045b0d32,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:09.180240 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5d83fc73-d8c3-48ad-9355-03120aa5c5f1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.203391 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5d83fc73-d8c3-48ad-9355-03120aa5c5f1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.255386 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5d83fc73-d8c3-48ad-9355-03120aa5c5f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.258532 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5d83fc73-d8c3-48ad-9355-03120aa5c5f1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.259455 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9f81f8a-2ffe-442c-a8ec-56e354bc8c6a req-f54cb74b-a4ae-4df6-b80e-1f2fbbb813e6 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:09.259683 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-5d83fc73-d8c3-48ad-9355-03120aa5c5f1 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/949da0ca-07b2-4c30-80f7-afb4045b0d32 HTTP/1.1" status: 204 len: 168 time: 0.1329546 Sep 01 16:59:09.261642 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a9f81f8a-2ffe-442c-a8ec-56e354bc8c6a req-f54cb74b-a4ae-4df6-b80e-1f2fbbb813e6 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0915902 Sep 01 16:59:09.275968 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d83fc73-d8c3-48ad-9355-03120aa5c5f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=949da0ca-07b2-4c30-80f7-afb4045b0d32,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:09.350527 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a9f81f8a-2ffe-442c-a8ec-56e354bc8c6a req-f25b45d5-6bc9-4870-8835-36e046b34a3c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0816402 Sep 01 16:59:09.411288 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5489450d-8bf9-4b41-ad20-bec3e03d9f30 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 16:59:09.523246 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5489450d-8bf9-4b41-ad20-bec3e03d9f30 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 16:59:09.528381 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5489450d-8bf9-4b41-ad20-bec3e03d9f30 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.538343 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47f1ce47-b07d-454b-91b7-d3289fdc2ce8 None None] Sync routers for ids ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 16:59:09.550190 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47f1ce47-b07d-454b-91b7-d3289fdc2ce8 None None] Routers {'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:59:09.551024 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-47f1ce47-b07d-454b-91b7-d3289fdc2ce8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:58:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:09.555926 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 52152) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:09.559410 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-5489450d-8bf9-4b41-ad20-bec3e03d9f30 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "PUT /v2.0/floatingips/8d24ba55-ba66-4fe7-84c7-fbf7569b66f7 HTTP/1.1" status: 200 len: 990 time: 1.6679204 Sep 01 16:59:09.560169 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'tag': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb'}] {{(pid=93836) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 16:59:09.573171 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}60a7e58791dd3a103db7a0d35103b09d0a4cb2c205e1177c181e158a6fe3866f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-65d478b7-ebce-4943-828f-2e1565b9bce2" -d '{"events": [{"name": "network-changed", "server_uuid": "0678fbe1-e92f-49b6-93cd-5babcfc2de18", "tag": "f3cd3382-a1bb-4f12-b1b1-64bd000296fb"}]}' {{(pid=93836) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 16:59:09.580392 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c9a7aa7d-95f7-4b4c-827f-46572fe5a497 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.622132 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 16:59:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8aa61a6f-a44b-409c-b8df-c46ca0e04a01 x-openstack-request-id: req-8aa61a6f-a44b-409c-b8df-c46ca0e04a01 {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 16:59:09.622534 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0678fbe1-e92f-49b6-93cd-5babcfc2de18", "tag": "f3cd3382-a1bb-4f12-b1b1-64bd000296fb", "status": "completed", "code": 200}]} {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 16:59:09.623007 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-8aa61a6f-a44b-409c-b8df-c46ca0e04a01 {{(pid=93836) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 16:59:09.623556 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'tag': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'status': 'completed', 'code': 200} Sep 01 16:59:09.676218 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-47f1ce47-b07d-454b-91b7-d3289fdc2ce8 None None] Set router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:59:09.681437 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c9a7aa7d-95f7-4b4c-827f-46572fe5a497 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.686830 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c9a7aa7d-95f7-4b4c-827f-46572fe5a497 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.726259 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-c9a7aa7d-95f7-4b4c-827f-46572fe5a497 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=09691e14eab642bb9eb050203a1f7fd0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1689332 Sep 01 16:59:09.728881 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52160) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:09.739239 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9a7aa7d-95f7-4b4c-827f-46572fe5a497 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b9aa5fb9-c59b-4390-9faa-7581e9a0c8f0,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:09.783253 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-50de3ef2-c83d-456d-936a-dbbe17d4db82 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.804448 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-50de3ef2-c83d-456d-936a-dbbe17d4db82 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.855210 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-50de3ef2-c83d-456d-936a-dbbe17d4db82 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.858206 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-50de3ef2-c83d-456d-936a-dbbe17d4db82 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:09.859417 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-50de3ef2-c83d-456d-936a-dbbe17d4db82 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/b9aa5fb9-c59b-4390-9faa-7581e9a0c8f0 HTTP/1.1" status: 204 len: 168 time: 0.1294885 Sep 01 16:59:09.867651 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50de3ef2-c83d-456d-936a-dbbe17d4db82 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b9aa5fb9-c59b-4390-9faa-7581e9a0c8f0,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:09.964132 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-47f1ce47-b07d-454b-91b7-d3289fdc2ce8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '8d24ba55-ba66-4fe7-84c7-fbf7569b66f7', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'floating_ip_address': '172.27.1.60', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'port_id': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 135, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'mac_address': 'fa:16:3e:95:9e:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T16:58:41Z', 'updated_at': '2021-09-01T16:59:08Z', 'revision_number': 1, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:39Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:10.082381 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47f1ce47-b07d-454b-91b7-d3289fdc2ce8 None None] Checking router: e95cfaf6-7dbf-4e42-af63-5c1ea40c693e for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 16:59:10.091040 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47f1ce47-b07d-454b-91b7-d3289fdc2ce8 None None] Routers {'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:59:10.091689 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-47f1ce47-b07d-454b-91b7-d3289fdc2ce8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:58:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:10.197827 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-47f1ce47-b07d-454b-91b7-d3289fdc2ce8 None None] Set router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:59:10.431553 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-47f1ce47-b07d-454b-91b7-d3289fdc2ce8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '8d24ba55-ba66-4fe7-84c7-fbf7569b66f7', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'floating_ip_address': '172.27.1.60', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'port_id': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 135, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'mac_address': 'fa:16:3e:95:9e:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T16:58:41Z', 'updated_at': '2021-09-01T16:59:08Z', 'revision_number': 1, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:39Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:10.463102 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47f1ce47-b07d-454b-91b7-d3289fdc2ce8 None None] The sync data for ids ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'] in dv-cinder-799668-16-iscsi is: [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '8d24ba55-ba66-4fe7-84c7-fbf7569b66f7', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'floating_ip_address': '172.27.1.60', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'port_id': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 135, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'mac_address': 'fa:16:3e:95:9e:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T16:58:41Z', 'updated_at': '2021-09-01T16:59:08Z', 'revision_number': 1, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:39Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 16:59:10.483958 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa846446-483a-48ed-aee1-4bca7df7b180 req-af2592fe-1958-4db4-ae41-6258e0b24670 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:10.485553 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-aa846446-483a-48ed-aee1-4bca7df7b180 req-af2592fe-1958-4db4-ae41-6258e0b24670 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0594435 Sep 01 16:59:10.527859 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-aa846446-483a-48ed-aee1-4bca7df7b180 req-379fa832-b6f1-48fc-80a3-1d66f42c63da tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358272 Sep 01 16:59:10.727695 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cef954a3-e18a-420d-a15e-450d3c7f8980 None None] New status for floating IP 8d24ba55-ba66-4fe7-84c7-fbf7569b66f7: ACTIVE {{(pid=93837) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 16:59:11.309253 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d478b7-ebce-4943-828f-2e1565b9bce2 req-8ab04976-4f91-4122-bf19-ff2de94dae0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:11.310778 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-65d478b7-ebce-4943-828f-2e1565b9bce2 req-8ab04976-4f91-4122-bf19-ff2de94dae0e service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 1098 time: 0.0747230 Sep 01 16:59:11.319470 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bac3c6-67a2-491b-8e73-5deb0319d82f req-f795673e-d5d2-44b6-8de3-67bb09cfa968 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:11.320922 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-33bac3c6-67a2-491b-8e73-5deb0319d82f req-f795673e-d5d2-44b6-8de3-67bb09cfa968 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=4199ca0b18374af7856c19238fc2fea1&device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 1098 time: 0.0535779 Sep 01 16:59:11.491111 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bac3c6-67a2-491b-8e73-5deb0319d82f req-cc70d74b-b0eb-4f3c-a9b0-3f57b4d51391 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:11.492599 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-33bac3c6-67a2-491b-8e73-5deb0319d82f req-cc70d74b-b0eb-4f3c-a9b0-3f57b4d51391 service neutron] 10.222.0.69 "GET /v2.0/networks?id=63606bb0-66bd-46d6-ba6c-55c6da830865 HTTP/1.1" status: 200 len: 920 time: 0.1565328 Sep 01 16:59:11.493956 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d478b7-ebce-4943-828f-2e1565b9bce2 req-4feb35fd-2c53-4647-8512-bc72d5d34c73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:11.495835 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-65d478b7-ebce-4943-828f-2e1565b9bce2 req-4feb35fd-2c53-4647-8512-bc72d5d34c73 service neutron] 10.222.0.69 "GET /v2.0/networks?id=2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 200 len: 917 time: 0.1604252 Sep 01 16:59:11.601217 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-33bac3c6-67a2-491b-8e73-5deb0319d82f req-59d9923a-9d56-4454-b1e6-dc14c1169c7e service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5e47292e-406f-4ed9-9215-3dcfba5fcde4 HTTP/1.1" status: 200 len: 217 time: 0.0884130 Sep 01 16:59:11.670692 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9c78db6-5e23-41de-b130-d9abe63c786f req-676d4b5b-ac80-44b4-9a7c-1118e2c88290 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:11.672728 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d9c78db6-5e23-41de-b130-d9abe63c786f req-676d4b5b-ac80-44b4-9a7c-1118e2c88290 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0565352 Sep 01 16:59:11.703002 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-65d478b7-ebce-4943-828f-2e1565b9bce2 req-ee4660aa-b8d4-4909-b2e0-672b45d4e57e service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb HTTP/1.1" status: 200 len: 1000 time: 0.1915636 Sep 01 16:59:11.720914 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d9c78db6-5e23-41de-b130-d9abe63c786f req-681d1fcc-d186-429a-81f5-9d1000a7b052 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402687 Sep 01 16:59:11.726159 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bac3c6-67a2-491b-8e73-5deb0319d82f req-b5f1c883-eb0d-49fc-901b-cb3de014a2d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:11.727572 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-33bac3c6-67a2-491b-8e73-5deb0319d82f req-b5f1c883-eb0d-49fc-901b-cb3de014a2d8 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd331d5b-40b1-4163-8537-7af4e56f1efd HTTP/1.1" status: 200 len: 859 time: 0.0717285 Sep 01 16:59:11.780312 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-33bac3c6-67a2-491b-8e73-5deb0319d82f req-47bb3974-9c5c-4f3b-ae0c-f799f6cca6f1 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=63606bb0-66bd-46d6-ba6c-55c6da830865&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0351655 Sep 01 16:59:11.787051 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d478b7-ebce-4943-828f-2e1565b9bce2 req-c09db555-3542-429d-a1f4-7665a5463bee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:11.788399 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-65d478b7-ebce-4943-828f-2e1565b9bce2 req-c09db555-3542-429d-a1f4-7665a5463bee service neutron] 10.222.0.69 "GET /v2.0/subnets?id=58fe425a-6b3e-47bd-b5c0-e68ea7782780 HTTP/1.1" status: 200 len: 855 time: 0.0731206 Sep 01 16:59:12.835426 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6de3b1ef-6145-43e8-9442-8550e956ed54 req-1c294df2-3426-4bb9-9df3-ae414ec7566d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:12.836868 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6de3b1ef-6145-43e8-9442-8550e956ed54 req-1c294df2-3426-4bb9-9df3-ae414ec7566d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0507584 Sep 01 16:59:12.873363 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6de3b1ef-6145-43e8-9442-8550e956ed54 req-6bf48d7a-1e45-4743-bef5-54aff2676caf tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0299387 Sep 01 16:59:13.922101 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-33bac3c6-67a2-491b-8e73-5deb0319d82f req-7eb30a94-fefb-4852-887d-1db8d751223b service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856857 Sep 01 16:59:13.985774 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f182f9b9-5dda-4265-9e69-480874677668 req-9e5268fe-4088-4d94-b4b1-4198d7c641c1 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:13.987275 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f182f9b9-5dda-4265-9e69-480874677668 req-9e5268fe-4088-4d94-b4b1-4198d7c641c1 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0477567 Sep 01 16:59:14.024511 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f182f9b9-5dda-4265-9e69-480874677668 req-0585cf4a-64b0-4d3b-a812-878eb4be6bdf tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314124 Sep 01 16:59:15.001339 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d478b7-ebce-4943-828f-2e1565b9bce2 req-4ed3a478-f214-4a53-8683-6cdbac58d714 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:15.002793 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-65d478b7-ebce-4943-828f-2e1565b9bce2 req-4ed3a478-f214-4a53-8683-6cdbac58d714 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2f7bfe5e-0012-467f-ad7f-aea2467233ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0954733 Sep 01 16:59:15.066816 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-33bac3c6-67a2-491b-8e73-5deb0319d82f req-904cb7a3-c1ee-4474-8e05-e36f00109c86 service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1581118 Sep 01 16:59:15.110873 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-65d478b7-ebce-4943-828f-2e1565b9bce2 req-eed75cdb-c4ff-4a4e-a34c-8b11d88a3638 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0985100 Sep 01 16:59:15.148714 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b19937-bedf-4958-bf7a-4dcf3db40a8c req-6f4f45e9-4df7-47b5-b695-66be14cd0c4d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:15.150840 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-06b19937-bedf-4958-bf7a-4dcf3db40a8c req-6f4f45e9-4df7-47b5-b695-66be14cd0c4d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0519142 Sep 01 16:59:15.192607 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-06b19937-bedf-4958-bf7a-4dcf3db40a8c req-ff3a1f4b-a3d5-4cd4-8cf5-af4944a6fca8 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0348780 Sep 01 16:59:15.215213 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-65d478b7-ebce-4943-828f-2e1565b9bce2 req-7a586858-d65c-476c-867c-3f62d784f44c service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0898545 Sep 01 16:59:16.328764 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87a05ea8-755e-4e93-bf5c-366e7ad91101 req-1d433229-b2da-4950-aa6b-8defc33a5e1e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:16.330260 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-87a05ea8-755e-4e93-bf5c-366e7ad91101 req-1d433229-b2da-4950-aa6b-8defc33a5e1e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0602372 Sep 01 16:59:16.369290 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-87a05ea8-755e-4e93-bf5c-366e7ad91101 req-90825792-43b8-4a48-a21d-b30e3ef0178f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327415 Sep 01 16:59:17.492585 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9d4cd3-5daa-4612-b862-31b6498403ac req-d61a9844-cd5a-448e-9bb9-ca959185463b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:17.495646 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0a9d4cd3-5daa-4612-b862-31b6498403ac req-d61a9844-cd5a-448e-9bb9-ca959185463b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0571089 Sep 01 16:59:17.538704 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0a9d4cd3-5daa-4612-b862-31b6498403ac req-bb029b55-3eb5-4e89-9084-2395cca0f74f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0369110 Sep 01 16:59:18.004219 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 52404) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:18.126383 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:18.224177 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:18.228042 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:18.266865 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=bfa6760e4cb445f3b2df165e78fe16b5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2607214 Sep 01 16:59:18.266865 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=51322e77-06e8-4db8-be53-8eb3af614a7b,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:18.268684 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52420) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:18.274153 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.274510 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.274855 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.275192 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.275823 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.276732 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.277565 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.277565 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.277752 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.278063 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.278388 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.278710 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93fe8bac-fe3c-49c1-87e9-f1ba4b9023a7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.319481 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:18.342587 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:18.394858 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:18.397361 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:18.398465 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/51322e77-06e8-4db8-be53-8eb3af614a7b HTTP/1.1" status: 204 len: 168 time: 0.1286395 Sep 01 16:59:18.407619 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=51322e77-06e8-4db8-be53-8eb3af614a7b,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:18.414900 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.415256 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.415593 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.415926 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.416258 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.416797 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.416797 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.418802 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.418802 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.418802 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.418802 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.418802 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f3f2b294-3922-4a89-9b59-8b7cfc658187 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:18.665209 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52d84811-3a31-401f-ba0b-e1e0675dd170 req-f7ef9baf-8a8a-4e0f-a8d3-880ae9498fd0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:18.667012 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-52d84811-3a31-401f-ba0b-e1e0675dd170 req-f7ef9baf-8a8a-4e0f-a8d3-880ae9498fd0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0559649 Sep 01 16:59:18.676938 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 52432) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:18.690976 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e81e4b77-ea0f-48c7-922d-43f00d6e3e17 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:18.724669 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-52d84811-3a31-401f-ba0b-e1e0675dd170 req-962d0479-3474-481d-b81b-19c598c15496 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512190 Sep 01 16:59:18.795453 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e81e4b77-ea0f-48c7-922d-43f00d6e3e17 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:18.799885 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e81e4b77-ea0f-48c7-922d-43f00d6e3e17 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:18.839065 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-e81e4b77-ea0f-48c7-922d-43f00d6e3e17 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=3dc05be2a19e40f5bc15d942f616ffcc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1609659 Sep 01 16:59:18.840165 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e81e4b77-ea0f-48c7-922d-43f00d6e3e17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c50942de-f4cd-424f-a0a0-f398592bf223,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:18.842025 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52442) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:18.911494 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-bb9ee205-e734-42f8-9c4d-ea960025bbd8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:18.936567 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-bb9ee205-e734-42f8-9c4d-ea960025bbd8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:18.992719 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-bb9ee205-e734-42f8-9c4d-ea960025bbd8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:18.996352 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-bb9ee205-e734-42f8-9c4d-ea960025bbd8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:19.000574 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-bb9ee205-e734-42f8-9c4d-ea960025bbd8 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/c50942de-f4cd-424f-a0a0-f398592bf223 HTTP/1.1" status: 204 len: 168 time: 0.1575453 Sep 01 16:59:19.010578 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb9ee205-e734-42f8-9c4d-ea960025bbd8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c50942de-f4cd-424f-a0a0-f398592bf223,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:19.502220 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52474) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:19.654539 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c360155b-9f17-4a88-84c7-4b175de939f8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:19.759058 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c360155b-9f17-4a88-84c7-4b175de939f8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:19.764599 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c360155b-9f17-4a88-84c7-4b175de939f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:19.817430 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c360155b-9f17-4a88-84c7-4b175de939f8 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=608240787f41417b85d144fda2296fc3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3140466 Sep 01 16:59:19.819633 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c360155b-9f17-4a88-84c7-4b175de939f8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ef2256b-8e52-4d27-9e3a-187974a981c6,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:19.823788 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 52490) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:19.860763 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50342cff-1654-43f4-93e5-28c42ab3b37e req-3e12e38c-0eec-456d-95f3-1d854f16258c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:19.862320 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-50342cff-1654-43f4-93e5-28c42ab3b37e req-3e12e38c-0eec-456d-95f3-1d854f16258c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0598187 Sep 01 16:59:19.882630 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-dca02d43-2c2b-4852-806f-0e57859278ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:19.903703 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-50342cff-1654-43f4-93e5-28c42ab3b37e req-1163ed39-8399-4105-8766-46190509f6a0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0344543 Sep 01 16:59:19.909034 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-dca02d43-2c2b-4852-806f-0e57859278ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:19.961925 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-dca02d43-2c2b-4852-806f-0e57859278ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:19.964998 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-dca02d43-2c2b-4852-806f-0e57859278ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:19.966164 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-dca02d43-2c2b-4852-806f-0e57859278ad admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/0ef2256b-8e52-4d27-9e3a-187974a981c6 HTTP/1.1" status: 204 len: 168 time: 0.1402490 Sep 01 16:59:19.973974 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dca02d43-2c2b-4852-806f-0e57859278ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ef2256b-8e52-4d27-9e3a-187974a981c6,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:20.330953 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52514) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:20.345283 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9650504d-d326-46e5-bf83-5ebb3ced213a admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:20.441154 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9650504d-d326-46e5-bf83-5ebb3ced213a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:20.446379 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9650504d-d326-46e5-bf83-5ebb3ced213a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:20.492079 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-9650504d-d326-46e5-bf83-5ebb3ced213a admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=2bc3b69ebacd4475b08696731c13477d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1599257 Sep 01 16:59:20.492920 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9650504d-d326-46e5-bf83-5ebb3ced213a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=431f0244-45bc-4fc8-859f-eeb0b59c0dfd,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:20.494993 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 52522) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:20.546864 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ab99897f-78c3-4189-a100-a986abcac0cd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:20.569315 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ab99897f-78c3-4189-a100-a986abcac0cd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:20.620434 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ab99897f-78c3-4189-a100-a986abcac0cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:20.622977 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ab99897f-78c3-4189-a100-a986abcac0cd admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:20.624135 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-ab99897f-78c3-4189-a100-a986abcac0cd admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/431f0244-45bc-4fc8-859f-eeb0b59c0dfd HTTP/1.1" status: 204 len: 168 time: 0.1277995 Sep 01 16:59:20.631784 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab99897f-78c3-4189-a100-a986abcac0cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=431f0244-45bc-4fc8-859f-eeb0b59c0dfd,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:21.035348 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a5889f-7ff0-4146-9427-39c16a2e980b req-597a9301-1051-4138-952c-c4b2a86f8cbd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:21.036873 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-85a5889f-7ff0-4146-9427-39c16a2e980b req-597a9301-1051-4138-952c-c4b2a86f8cbd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0536215 Sep 01 16:59:21.078550 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-85a5889f-7ff0-4146-9427-39c16a2e980b req-0b8622f0-8706-486b-a8a0-a9d414fba561 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0339379 Sep 01 16:59:21.256516 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-6a8dab54-afa1-4657-a278-1539cbb38f1c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:22.194682 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b10d2862-7d3a-471b-8c85-d4faa919097d req-bb949522-e35d-4a54-8a5b-727bb1712fee tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:22.201868 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b10d2862-7d3a-471b-8c85-d4faa919097d req-bb949522-e35d-4a54-8a5b-727bb1712fee tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0562441 Sep 01 16:59:22.236900 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b10d2862-7d3a-471b-8c85-d4faa919097d req-64e9238f-7e9d-462c-8b0a-83151286fe9d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0341625 Sep 01 16:59:22.325016 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 52610) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:22.441879 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2dbef207-65f6-4722-a949-1348a1c36534 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:22.532136 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2dbef207-65f6-4722-a949-1348a1c36534 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:22.536071 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2dbef207-65f6-4722-a949-1348a1c36534 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:22.576401 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-2dbef207-65f6-4722-a949-1348a1c36534 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=a00a92ccb66e4cd598496c8c243f7d0c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2501986 Sep 01 16:59:22.577422 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dbef207-65f6-4722-a949-1348a1c36534 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=95985e28-9a7d-4812-ae64-524ea3458807,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:22.578985 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52618) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:22.626360 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5ca3d4cd-56bd-4e86-b605-35635808edab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:22.646516 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5ca3d4cd-56bd-4e86-b605-35635808edab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:22.691756 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5ca3d4cd-56bd-4e86-b605-35635808edab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:22.694895 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5ca3d4cd-56bd-4e86-b605-35635808edab admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:22.696118 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-5ca3d4cd-56bd-4e86-b605-35635808edab admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/95985e28-9a7d-4812-ae64-524ea3458807 HTTP/1.1" status: 204 len: 168 time: 0.1161170 Sep 01 16:59:22.705897 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ca3d4cd-56bd-4e86-b605-35635808edab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=95985e28-9a7d-4812-ae64-524ea3458807,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:22.954707 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52626) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:22.970391 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2fb1e9c3-146d-403b-9b8b-e7d15888c95c admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:23.236552 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2fb1e9c3-146d-403b-9b8b-e7d15888c95c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:23.241523 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2fb1e9c3-146d-403b-9b8b-e7d15888c95c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:23.281944 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fb1e9c3-146d-403b-9b8b-e7d15888c95c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be3f6ffd-2769-4dd7-9285-f82d15690ea6,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:23.288475 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-2fb1e9c3-146d-403b-9b8b-e7d15888c95c admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=716544325e364618b91f3368d366b048&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3326607 Sep 01 16:59:23.291085 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52634) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:23.366853 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5cf32b5b-5845-4d47-bdc5-7cb4c6e65741 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:23.395181 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47f47952-befd-4be0-b41e-3f739af975e8 req-377e6b6e-bcb8-4cfa-87ad-db3fe975d81a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:23.397100 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-47f47952-befd-4be0-b41e-3f739af975e8 req-377e6b6e-bcb8-4cfa-87ad-db3fe975d81a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0722275 Sep 01 16:59:23.410644 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5cf32b5b-5845-4d47-bdc5-7cb4c6e65741 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:23.474504 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-47f47952-befd-4be0-b41e-3f739af975e8 req-d42a4b31-72e3-47d8-b715-dad5537a79d3 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662403 Sep 01 16:59:23.500578 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5cf32b5b-5845-4d47-bdc5-7cb4c6e65741 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:23.504442 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5cf32b5b-5845-4d47-bdc5-7cb4c6e65741 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:23.505590 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-5cf32b5b-5845-4d47-bdc5-7cb4c6e65741 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/be3f6ffd-2769-4dd7-9285-f82d15690ea6 HTTP/1.1" status: 204 len: 168 time: 0.2136059 Sep 01 16:59:23.514463 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cf32b5b-5845-4d47-bdc5-7cb4c6e65741 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be3f6ffd-2769-4dd7-9285-f82d15690ea6,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:23.767733 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:23.783487 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-f38850f7-4ebd-45ae-b8e1-53fc973ef702 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:24.613557 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b53027bb-60ee-4c0b-ac76-9e182d63a1e1 req-ed1233c6-df2e-4ef7-941f-65548771595e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:24.615644 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b53027bb-60ee-4c0b-ac76-9e182d63a1e1 req-ed1233c6-df2e-4ef7-941f-65548771595e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0657585 Sep 01 16:59:24.662821 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b53027bb-60ee-4c0b-ac76-9e182d63a1e1 req-2d3c9a23-6784-4364-b711-b01400ae6444 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391052 Sep 01 16:59:24.755981 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52728) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:24.881193 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:24.887230 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-41036595-5e74-48cf-9327-180cc6178234 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:25.005909 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-41036595-5e74-48cf-9327-180cc6178234 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:25.010511 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-41036595-5e74-48cf-9327-180cc6178234 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:25.054311 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41036595-5e74-48cf-9327-180cc6178234 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7db6d603-3043-4907-8708-6dba7d16fc08,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:25.062899 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 52744) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:25.063393 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-41036595-5e74-48cf-9327-180cc6178234 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=c5a864e62cb641078a4c822a496dd86c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3061662 Sep 01 16:59:25.127973 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-343b71a7-5863-49c2-a07b-d11d186e5ee9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:25.148786 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-343b71a7-5863-49c2-a07b-d11d186e5ee9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:25.195388 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-343b71a7-5863-49c2-a07b-d11d186e5ee9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:25.198008 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-343b71a7-5863-49c2-a07b-d11d186e5ee9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:25.199147 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-343b71a7-5863-49c2-a07b-d11d186e5ee9 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/7db6d603-3043-4907-8708-6dba7d16fc08 HTTP/1.1" status: 204 len: 168 time: 0.1342659 Sep 01 16:59:25.206679 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-343b71a7-5863-49c2-a07b-d11d186e5ee9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7db6d603-3043-4907-8708-6dba7d16fc08,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:25.661333 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 52778) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:25.820349 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-925d2ffb-8092-4c58-882f-c515ad74e9a6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:25.828948 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c490d88-f6da-48ef-b495-e31a603ec862 req-03160902-bfa9-47f6-911a-60dc4b6d3de3 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:25.833916 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8c490d88-f6da-48ef-b495-e31a603ec862 req-03160902-bfa9-47f6-911a-60dc4b6d3de3 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0736010 Sep 01 16:59:25.876214 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8c490d88-f6da-48ef-b495-e31a603ec862 req-a7dad56e-dee6-453f-9df7-0af9d02c5e7a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378041 Sep 01 16:59:25.949637 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-925d2ffb-8092-4c58-882f-c515ad74e9a6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:25.953553 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-925d2ffb-8092-4c58-882f-c515ad74e9a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:25.996186 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52796) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:25.996528 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-925d2ffb-8092-4c58-882f-c515ad74e9a6 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=2d5915012c214be9a71ff4862cccda12&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3337133 Sep 01 16:59:25.997113 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-925d2ffb-8092-4c58-882f-c515ad74e9a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aeeac66d-25bc-49cd-803d-fd8d413ce6ca,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:26.028545 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2d61d3e-270c-4845-97a6-df9469caf881 req-234e5d2c-029d-4d70-add7-8c2c16a5224e tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:26.030172 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d2d61d3e-270c-4845-97a6-df9469caf881 req-234e5d2c-029d-4d70-add7-8c2c16a5224e tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 945 time: 0.0689101 Sep 01 16:59:26.094646 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5f7f7086-2313-4b80-8cf0-0711ece5136c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:26.099503 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d2d61d3e-270c-4845-97a6-df9469caf881 req-7415d85c-fcd2-40c2-9c1a-e0fa2251b848 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606849 Sep 01 16:59:26.121630 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5f7f7086-2313-4b80-8cf0-0711ece5136c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:26.173193 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5f7f7086-2313-4b80-8cf0-0711ece5136c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:26.175758 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5f7f7086-2313-4b80-8cf0-0711ece5136c admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:26.176915 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-5f7f7086-2313-4b80-8cf0-0711ece5136c admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/aeeac66d-25bc-49cd-803d-fd8d413ce6ca HTTP/1.1" status: 204 len: 168 time: 0.1793265 Sep 01 16:59:26.193312 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f7f7086-2313-4b80-8cf0-0711ece5136c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aeeac66d-25bc-49cd-803d-fd8d413ce6ca,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:26.426682 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:26.522227 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:26.576491 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52822) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:26.591817 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2f4616ee-30c8-450a-a02a-d0df7664d340 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:26.696271 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2f4616ee-30c8-450a-a02a-d0df7664d340 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:26.700744 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2f4616ee-30c8-450a-a02a-d0df7664d340 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:26.742180 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-2f4616ee-30c8-450a-a02a-d0df7664d340 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=5792f05cfca54f1fa9787c2263260d35&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1643598 Sep 01 16:59:26.743327 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f4616ee-30c8-450a-a02a-d0df7664d340 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=885cd36b-5041-4d2c-8e6f-81baf9076db9,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:26.745965 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52828) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:26.804310 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9ef59320-e101-4528-987d-79ecd46dad9d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:26.815637 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-47d335ba-50ec-4529-a83c-a7cce62ba2a1 req-845922f2-0d7e-42bb-8b80-395b2dc8adca service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2210343 Sep 01 16:59:26.830613 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9ef59320-e101-4528-987d-79ecd46dad9d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:26.882270 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9ef59320-e101-4528-987d-79ecd46dad9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:26.884815 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9ef59320-e101-4528-987d-79ecd46dad9d admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:26.886067 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-9ef59320-e101-4528-987d-79ecd46dad9d admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/885cd36b-5041-4d2c-8e6f-81baf9076db9 HTTP/1.1" status: 204 len: 168 time: 0.1389003 Sep 01 16:59:26.894062 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ef59320-e101-4528-987d-79ecd46dad9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=885cd36b-5041-4d2c-8e6f-81baf9076db9,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:26.937477 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47d335ba-50ec-4529-a83c-a7cce62ba2a1 req-055af18c-8683-4b47-8449-c92d0314da70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:26.939071 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-47d335ba-50ec-4529-a83c-a7cce62ba2a1 req-055af18c-8683-4b47-8449-c92d0314da70 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7032b30e75954f8da9ad2cb64f1f5ad1&device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 1098 time: 0.0460095 Sep 01 16:59:27.005013 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38d081b0-3887-48b3-9d19-a7e6364af303 req-1579f88d-9ec1-4bce-9e39-d2dc235ddcc5 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:27.006828 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-38d081b0-3887-48b3-9d19-a7e6364af303 req-1579f88d-9ec1-4bce-9e39-d2dc235ddcc5 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0517974 Sep 01 16:59:27.054013 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-38d081b0-3887-48b3-9d19-a7e6364af303 req-b71f692f-4ee6-4bde-99f4-56486bebf14f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408208 Sep 01 16:59:27.061153 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47d335ba-50ec-4529-a83c-a7cce62ba2a1 req-26b83e94-5605-4feb-b18a-8fc4cf0cae4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:27.063138 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-47d335ba-50ec-4529-a83c-a7cce62ba2a1 req-26b83e94-5605-4feb-b18a-8fc4cf0cae4a service neutron] 10.222.0.69 "GET /v2.0/networks?id=8331b65a-166e-454c-a3c5-ed861dc82dfc HTTP/1.1" status: 200 len: 915 time: 0.0926685 Sep 01 16:59:27.115604 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-47d335ba-50ec-4529-a83c-a7cce62ba2a1 req-21c886dc-68ee-4c43-bc9f-301b77fbaa34 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=3890e11d-5295-488a-9033-9814bb94bf69 HTTP/1.1" status: 200 len: 217 time: 0.0385063 Sep 01 16:59:27.178383 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47d335ba-50ec-4529-a83c-a7cce62ba2a1 req-0e20e1f8-bfd1-4def-8c09-1920a9e4aae7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:27.180382 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-47d335ba-50ec-4529-a83c-a7cce62ba2a1 req-0e20e1f8-bfd1-4def-8c09-1920a9e4aae7 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd025a14-8839-4451-a03e-bc7daeb612d0 HTTP/1.1" status: 200 len: 854 time: 0.0470266 Sep 01 16:59:27.220172 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-47d335ba-50ec-4529-a83c-a7cce62ba2a1 req-0b42ca7d-5c60-48ec-9c97-872b87fba042 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8331b65a-166e-454c-a3c5-ed861dc82dfc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0268636 Sep 01 16:59:27.225924 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ca90d6b-39d1-4d12-9a72-c30a099634e2 req-a02dc763-45e6-4340-b615-785cc728989e tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:27.227531 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0ca90d6b-39d1-4d12-9a72-c30a099634e2 req-a02dc763-45e6-4340-b615-785cc728989e tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 945 time: 0.0532489 Sep 01 16:59:27.247731 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52838) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:27.265737 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8b4babb0-d7f0-45ce-92c1-7a7d16450f5c admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:27.288041 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0ca90d6b-39d1-4d12-9a72-c30a099634e2 req-d58a5a2d-b4ba-408d-8231-fd16595b18a7 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538297 Sep 01 16:59:27.335084 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-47d335ba-50ec-4529-a83c-a7cce62ba2a1 req-e1935b1f-d6cc-4a49-8c2e-627dbbaca3bd service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1037989 Sep 01 16:59:27.379950 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8b4babb0-d7f0-45ce-92c1-7a7d16450f5c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:27.386144 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8b4babb0-d7f0-45ce-92c1-7a7d16450f5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:27.440038 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-47d335ba-50ec-4529-a83c-a7cce62ba2a1 req-c25f9030-62d8-4af5-91d2-54919a1a08f9 service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0956123 Sep 01 16:59:27.445356 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-8b4babb0-d7f0-45ce-92c1-7a7d16450f5c admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=a99ae19f983f45be9788e31515371e2c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1964195 Sep 01 16:59:27.446156 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b4babb0-d7f0-45ce-92c1-7a7d16450f5c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1f2faa6-ae89-4b75-8b32-1503bb013f79,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:27.448021 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 52872) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:27.504920 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1470607f-a325-4e53-bd2a-d19fc3572913 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:27.529567 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1470607f-a325-4e53-bd2a-d19fc3572913 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:27.586893 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1470607f-a325-4e53-bd2a-d19fc3572913 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:27.589956 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1470607f-a325-4e53-bd2a-d19fc3572913 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:27.595631 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-1470607f-a325-4e53-bd2a-d19fc3572913 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/d1f2faa6-ae89-4b75-8b32-1503bb013f79 HTTP/1.1" status: 204 len: 168 time: 0.1445990 Sep 01 16:59:27.617508 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1470607f-a325-4e53-bd2a-d19fc3572913 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1f2faa6-ae89-4b75-8b32-1503bb013f79,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:27.749587 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52904) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:27.938395 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4e14d087-aeca-4f55-8018-deeece402cae admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.062207 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4e14d087-aeca-4f55-8018-deeece402cae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.066920 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4e14d087-aeca-4f55-8018-deeece402cae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.125724 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-4e14d087-aeca-4f55-8018-deeece402cae admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=df9e864884ff4bd086f70cb5c3856cd0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3742967 Sep 01 16:59:28.126495 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e14d087-aeca-4f55-8018-deeece402cae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f45f0fad-d78d-406f-a08f-bb80ba26fd6b,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:28.127877 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 52938) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:28.203663 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-812a575e-fedc-450d-afcf-d623fe2ede90 req-53ced371-5df2-436b-a46c-fc525f769708 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:28.205640 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-812a575e-fedc-450d-afcf-d623fe2ede90 req-53ced371-5df2-436b-a46c-fc525f769708 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0677388 Sep 01 16:59:28.220483 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1a619a07-6efa-495b-b62b-f801244b0107 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.248213 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1a619a07-6efa-495b-b62b-f801244b0107 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.270214 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-812a575e-fedc-450d-afcf-d623fe2ede90 req-3647c0b1-3ddc-4f4d-a0a0-0f2a03566892 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498977 Sep 01 16:59:28.321829 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1a619a07-6efa-495b-b62b-f801244b0107 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.325257 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1a619a07-6efa-495b-b62b-f801244b0107 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.327715 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-1a619a07-6efa-495b-b62b-f801244b0107 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/f45f0fad-d78d-406f-a08f-bb80ba26fd6b HTTP/1.1" status: 204 len: 168 time: 0.1987846 Sep 01 16:59:28.338030 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a619a07-6efa-495b-b62b-f801244b0107 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f45f0fad-d78d-406f-a08f-bb80ba26fd6b,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:28.480389 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a786fb1-9437-4704-a221-0d9756c86693 req-e3af443a-3648-4731-a151-5c48aec433cf tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:28.482481 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0a786fb1-9437-4704-a221-0d9756c86693 req-e3af443a-3648-4731-a151-5c48aec433cf tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 945 time: 0.0885377 Sep 01 16:59:28.529560 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0a786fb1-9437-4704-a221-0d9756c86693 req-16522d32-53be-4ba6-b346-2f0c992f69ff tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/security-groups?id=edb52b36-a4c0-45b6-aa6e-81d4764b67ef&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403824 Sep 01 16:59:28.566272 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 52978) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:28.688995 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52982) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:28.703030 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9c735362-c53f-4ab8-ae65-9901268c7126 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.711484 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1315936631-network', 'tenant_id': 'f0cfb9e68822461d8ee9f5d1aa2c1831'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:59:28.778384 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a0969e8-220f-41d0-9ab5-4b8012ff8471 req-db45892c-4bbd-4f0e-925d-a9a91beb2e86 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:28.780035 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-8a0969e8-220f-41d0-9ab5-4b8012ff8471 req-db45892c-4bbd-4f0e-925d-a9a91beb2e86 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.69 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 945 time: 0.1153433 Sep 01 16:59:28.795534 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9c735362-c53f-4ab8-ae65-9901268c7126 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.799370 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9c735362-c53f-4ab8-ae65-9901268c7126 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.843950 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-9c735362-c53f-4ab8-ae65-9901268c7126 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=c52aa0f603814930ab0b783fa88596bc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1536040 Sep 01 16:59:28.846204 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c735362-c53f-4ab8-ae65-9901268c7126 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d1ad231-5810-4fc8-ade6-1bd4b64828f6,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:28.849067 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 52984) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:28.878045 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] Made reservation on behalf of f0cfb9e68822461d8ee9f5d1aa2c1831 for: {'network': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:59:28.880303 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.906047 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-80e7a941-4d1f-493f-b2ed-3014ff5f13c9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.914739 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.930905 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-80e7a941-4d1f-493f-b2ed-3014ff5f13c9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.987613 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-8a0969e8-220f-41d0-9ab5-4b8012ff8471 req-f2f805d6-8b2d-47bf-be92-0d2071b9e5ca tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Deleting port ecc1fde7-837e-4490-b1f8-93b04ddaab48 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 16:59:28.988082 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-8a0969e8-220f-41d0-9ab5-4b8012ff8471 req-f2f805d6-8b2d-47bf-be92-0d2071b9e5ca tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.993532 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-80e7a941-4d1f-493f-b2ed-3014ff5f13c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:28.997692 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-80e7a941-4d1f-493f-b2ed-3014ff5f13c9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:29.001230 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-80e7a941-4d1f-493f-b2ed-3014ff5f13c9 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/9d1ad231-5810-4fc8-ade6-1bd4b64828f6 HTTP/1.1" status: 204 len: 168 time: 0.1485274 Sep 01 16:59:29.014472 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80e7a941-4d1f-493f-b2ed-3014ff5f13c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d1ad231-5810-4fc8-ade6-1bd4b64828f6,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:29.123574 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-8a0969e8-220f-41d0-9ab5-4b8012ff8471 req-f2f805d6-8b2d-47bf-be92-0d2071b9e5ca tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] For port ecc1fde7-837e-4490-b1f8-93b04ddaab48, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=ecc1fde7-837e-4490-b1f8-93b04ddaab48,segment=NetworkSegment(2785b39f-9a72-4d03-a737-382dced1c97a),segment_id=2785b39f-9a72-4d03-a737-382dced1c97a)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:59:29.123574 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-8a0969e8-220f-41d0-9ab5-4b8012ff8471 req-f2f805d6-8b2d-47bf-be92-0d2071b9e5ca tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:29.145020 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:29.147181 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-8a0969e8-220f-41d0-9ab5-4b8012ff8471 req-f2f805d6-8b2d-47bf-be92-0d2071b9e5ca tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Calling delete_port for ecc1fde7-837e-4490-b1f8-93b04ddaab48 owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 16:59:29.163268 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:29.236835 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] vlan segment allocate from pool success with {'vlan_id': 504, 'physical_network': 'physnet1'} {{(pid=93835) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 16:59:29.258395 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57d0273f-71b0-483b-b16b-2aa8887797f6,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:29.264918 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:29.265557 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.segments_db [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] Added segment 73857864-3ac7-43cb-ad32-4e89a807ad40 of type vlan for network 940b3cbc-0267-4c44-814a-a1e84335cc72 Sep 01 16:59:29.319763 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:29.386776 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:29.387909 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:29.388601 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:29.398528 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ffb35f3-f9bb-46bb-94e9-f8a5ed07b967 req-4e80f1c7-c138-4176-844c-d8ea55062192 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:29.400852 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7ffb35f3-f9bb-46bb-94e9-f8a5ed07b967 req-4e80f1c7-c138-4176-844c-d8ea55062192 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0529058 Sep 01 16:59:29.443584 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7ffb35f3-f9bb-46bb-94e9-f8a5ed07b967 req-7afe5213-f76b-479e-b3ad-42a42a96372e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0354588 Sep 01 16:59:29.465429 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.8920937 Sep 01 16:59:29.465657 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53004) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:29.472421 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd830bf1-3785-44ae-9c5a-f193b1bc7167 admin admin] Pushing event updated for resources: {'Network': ['ID=940b3cbc-0267-4c44-814a-a1e84335cc72,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:29.475255 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-8a0969e8-220f-41d0-9ab5-4b8012ff8471 req-f2f805d6-8b2d-47bf-be92-0d2071b9e5ca tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:29.479682 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-f1486d01-96a0-4d54-a223-78a860ef53a3 admin admin] Request body: {'subnet': {'network_id': '940b3cbc-0267-4c44-814a-a1e84335cc72', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1315936631-subnet', 'tenant_id': 'f0cfb9e68822461d8ee9f5d1aa2c1831', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:59:29.488527 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network 940b3cbc-0267-4c44-814a-a1e84335cc72 details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 16:59:29.505758 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f1486d01-96a0-4d54-a223-78a860ef53a3 admin admin] Made reservation on behalf of f0cfb9e68822461d8ee9f5d1aa2c1831 for: {'subnet': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:59:29.508208 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f1486d01-96a0-4d54-a223-78a860ef53a3 admin admin] Notify callbacks [] for subnet, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:29.538997 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['ecc1fde7-837e-4490-b1f8-93b04ddaab48'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 16:59:29.593442 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2f805d6-8b2d-47bf-be92-0d2071b9e5ca tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Pushing event deleted for resources: {'Port': ['ID=ecc1fde7-837e-4490-b1f8-93b04ddaab48,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:29.684247 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a0969e8-220f-41d0-9ab5-4b8012ff8471 req-f2f805d6-8b2d-47bf-be92-0d2071b9e5ca tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] No DVR routers for this DVR port ecc1fde7-837e-4490-b1f8-93b04ddaab48 on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 16:59:29.689684 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-8a0969e8-220f-41d0-9ab5-4b8012ff8471 req-f2f805d6-8b2d-47bf-be92-0d2071b9e5ca tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:29.692345 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-8a0969e8-220f-41d0-9ab5-4b8012ff8471 req-f2f805d6-8b2d-47bf-be92-0d2071b9e5ca tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.69 "DELETE /v2.0/ports/ecc1fde7-837e-4490-b1f8-93b04ddaab48 HTTP/1.1" status: 204 len: 173 time: 0.9055443 Sep 01 16:59:29.693322 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e18ee49e-3bbd-4cca-ae7e-0185ef0d225c', 'name': 'network-vif-deleted', 'tag': 'ecc1fde7-837e-4490-b1f8-93b04ddaab48'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 16:59:29.704329 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-52d2829d-123c-4d80-9d85-61fc16f13f95" -d '{"events": [{"server_uuid": "e18ee49e-3bbd-4cca-ae7e-0185ef0d225c", "name": "network-vif-deleted", "tag": "ecc1fde7-837e-4490-b1f8-93b04ddaab48"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 16:59:29.722028 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-886c3c63-868f-4823-a1d2-2bd19b3f5e82 req-f6929003-c8a7-4aab-8f59-f87bc5dcb5a5 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 210 time: 0.0555508 Sep 01 16:59:29.777481 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 16:59:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f83c653d-f827-4531-819b-31394dfc62a2 x-openstack-request-id: req-f83c653d-f827-4531-819b-31394dfc62a2 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 16:59:29.777778 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e18ee49e-3bbd-4cca-ae7e-0185ef0d225c", "name": "network-vif-deleted", "tag": "ecc1fde7-837e-4490-b1f8-93b04ddaab48", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 16:59:29.778033 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-f83c653d-f827-4531-819b-31394dfc62a2 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 16:59:29.778435 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e18ee49e-3bbd-4cca-ae7e-0185ef0d225c', 'name': 'network-vif-deleted', 'tag': 'ecc1fde7-837e-4490-b1f8-93b04ddaab48', 'status': 'completed', 'code': 200} Sep 01 16:59:29.787468 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f1486d01-96a0-4d54-a223-78a860ef53a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for subnet, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:29.859323 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1486d01-96a0-4d54-a223-78a860ef53a3 admin admin] Checking segment: {'id': '73857864-3ac7-43cb-ad32-4e89a807ad40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '940b3cbc-0267-4c44-814a-a1e84335cc72'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93836) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:59:29.859733 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1486d01-96a0-4d54-a223-78a860ef53a3 admin admin] Network hostable DHCP agents. Network: 940b3cbc-0267-4c44-814a-a1e84335cc72, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93836) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 16:59:29.863312 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1486d01-96a0-4d54-a223-78a860ef53a3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=974a699d-c373-4a9b-b6f8-2b466e1f6074,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:29.884741 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1486d01-96a0-4d54-a223-78a860ef53a3 admin admin] Network 940b3cbc-0267-4c44-814a-a1e84335cc72 is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93836) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 16:59:29.894091 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-f1486d01-96a0-4d54-a223-78a860ef53a3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, 940b3cbc-0267-4c44-814a-a1e84335cc72) {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:59:29.898792 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1486d01-96a0-4d54-a223-78a860ef53a3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:29.899630 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f1486d01-96a0-4d54-a223-78a860ef53a3 admin admin] Notify callbacks [] for subnet, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:29.907605 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48544492-7065-42eb-8d2e-084ded94eba2 None None] Network 940b3cbc-0267-4c44-814a-a1e84335cc72 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:59:29.918536 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-f1486d01-96a0-4d54-a223-78a860ef53a3 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.4519506 Sep 01 16:59:29.935584 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53030) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:30.069091 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5aef301a-9499-487d-b846-8de5e17210dc None None] Network 940b3cbc-0267-4c44-814a-a1e84335cc72 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:59:30.073558 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-eb52f5e9-b953-45ea-9097-21bf1c01669e admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:30.247711 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-eb52f5e9-b953-45ea-9097-21bf1c01669e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:30.254337 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-eb52f5e9-b953-45ea-9097-21bf1c01669e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:30.324078 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-eb52f5e9-b953-45ea-9097-21bf1c01669e admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=a6256fd2e2224967a0526e7ab1dadd03&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3848639 Sep 01 16:59:30.324321 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53064) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:30.332825 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb52f5e9-b953-45ea-9097-21bf1c01669e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2253b58f-ea5d-4bf7-87a1-ae4c8d8cb804,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:30.383903 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9231f68d-b978-4f28-b6e4-c7718861f8dd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:30.433796 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9231f68d-b978-4f28-b6e4-c7718861f8dd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:30.491318 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9231f68d-b978-4f28-b6e4-c7718861f8dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:30.494020 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9231f68d-b978-4f28-b6e4-c7718861f8dd admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:30.495616 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-9231f68d-b978-4f28-b6e4-c7718861f8dd admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/2253b58f-ea5d-4bf7-87a1-ae4c8d8cb804 HTTP/1.1" status: 204 len: 168 time: 0.1695910 Sep 01 16:59:30.505369 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9231f68d-b978-4f28-b6e4-c7718861f8dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2253b58f-ea5d-4bf7-87a1-ae4c8d8cb804,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:30.600474 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5f1e04a-216b-4e26-a369-930dfa93f977 req-4104b224-b688-4a8b-9c2b-49de631fc82e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:30.601423 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f5f1e04a-216b-4e26-a369-930dfa93f977 req-4104b224-b688-4a8b-9c2b-49de631fc82e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0706978 Sep 01 16:59:30.641358 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53102) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:30.649150 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-2115415938-network', 'tenant_id': '410d0618fa564d0ea16217c3fdf4e81a'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:59:30.660221 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f5f1e04a-216b-4e26-a369-930dfa93f977 req-a0231cbc-f471-44bb-a5f6-90d78bf50239 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510826 Sep 01 16:59:30.686723 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] Made reservation on behalf of 410d0618fa564d0ea16217c3fdf4e81a for: {'network': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:59:30.689057 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:30.698010 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:30.845004 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:30.851836 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:30.882192 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] vlan segment allocate from pool success with {'vlan_id': 515, 'physical_network': 'physnet1'} {{(pid=93836) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 16:59:30.895583 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:30.895982 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.segments_db [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] Added segment 1b7bcfbe-09d0-423f-adfd-28ee178418eb of type vlan for network 84dafd1a-6428-413e-960f-2622db1fbcc8 Sep 01 16:59:30.981094 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a7980d4c-3ac0-4bc9-bf1f-6e8a1b4c9ffe req-4e163c0f-1cc1-4228-8f1e-cc8a9fd20b73 tempest-DeleteServersTestJSON-400513449 tempest-DeleteServersTestJSON-400513449-project] 10.222.0.67 "GET /v2.0/ports?device_id=e18ee49e-3bbd-4cca-ae7e-0185ef0d225c HTTP/1.1" status: 200 len: 210 time: 0.0454068 Sep 01 16:59:30.983422 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:30.989227 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e2070166-3955-45c7-91c5-73cfc31f6c7c,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:31.070687 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:31.071698 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:31.072286 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:31.128083 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4855642 Sep 01 16:59:31.130913 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53132) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:31.139008 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-f7cb1f0b-ee35-43f1-b5f8-f78a1ad31ba9 admin admin] Request body: {'subnet': {'network_id': '84dafd1a-6428-413e-960f-2622db1fbcc8', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-2115415938-subnet', 'tenant_id': '410d0618fa564d0ea16217c3fdf4e81a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:59:31.140681 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a6c898-5cc4-4259-8b64-86cbe13dfb4b admin admin] Pushing event updated for resources: {'Network': ['ID=84dafd1a-6428-413e-960f-2622db1fbcc8,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:31.151523 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network 84dafd1a-6428-413e-960f-2622db1fbcc8 details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 16:59:31.170757 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7cb1f0b-ee35-43f1-b5f8-f78a1ad31ba9 admin admin] Made reservation on behalf of 410d0618fa564d0ea16217c3fdf4e81a for: {'subnet': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:59:31.174037 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f7cb1f0b-ee35-43f1-b5f8-f78a1ad31ba9 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5120093'] for subnet, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:31.431634 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f7cb1f0b-ee35-43f1-b5f8-f78a1ad31ba9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7343016', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5120075'] for subnet, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:31.492670 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53152) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:31.503367 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7cb1f0b-ee35-43f1-b5f8-f78a1ad31ba9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2c6977a7-b240-470d-96b9-7c0ae25b66a2,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:31.515737 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7cb1f0b-ee35-43f1-b5f8-f78a1ad31ba9 admin admin] Checking segment: {'id': '1b7bcfbe-09d0-423f-adfd-28ee178418eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '84dafd1a-6428-413e-960f-2622db1fbcc8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:59:31.516106 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7cb1f0b-ee35-43f1-b5f8-f78a1ad31ba9 admin admin] Network hostable DHCP agents. Network: 84dafd1a-6428-413e-960f-2622db1fbcc8, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93835) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 16:59:31.534221 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7cb1f0b-ee35-43f1-b5f8-f78a1ad31ba9 admin admin] Network 84dafd1a-6428-413e-960f-2622db1fbcc8 is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93835) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 16:59:31.545614 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-f7cb1f0b-ee35-43f1-b5f8-f78a1ad31ba9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, 84dafd1a-6428-413e-960f-2622db1fbcc8) {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:59:31.550119 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7cb1f0b-ee35-43f1-b5f8-f78a1ad31ba9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:31.551395 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f7cb1f0b-ee35-43f1-b5f8-f78a1ad31ba9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:31.556530 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4eed4abd-72c4-46e7-9a27-097a3ee0877a None None] Network 84dafd1a-6428-413e-960f-2622db1fbcc8 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:59:31.595012 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-f7cb1f0b-ee35-43f1-b5f8-f78a1ad31ba9 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.4608741 Sep 01 16:59:31.633010 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-788092363-network', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:59:31.668925 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] Made reservation on behalf of ccf739a17862469f9bbcedc5abe17cd1 for: {'network': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:59:31.671271 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:31.681446 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:31.710494 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d208a54-9b52-47a6-b810-54e20d38fcb0 None None] Network 84dafd1a-6428-413e-960f-2622db1fbcc8 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:59:31.821075 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:31.833585 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c8c2265-5e45-4c23-b368-8c495a9fe2c1 req-614b5236-e282-4a93-8303-d8f3aa050f8f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:31.835479 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7c8c2265-5e45-4c23-b368-8c495a9fe2c1 req-614b5236-e282-4a93-8303-d8f3aa050f8f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0789840 Sep 01 16:59:31.836869 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:31.852719 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] vlan segment allocate from pool success with {'vlan_id': 508, 'physical_network': 'physnet1'} {{(pid=93836) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 16:59:31.894349 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:31.894611 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.segments_db [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] Added segment bd15a57e-34c6-42ac-abbb-bea94ad6f705 of type vlan for network ab951243-4254-4532-9d93-c294f4a98543 Sep 01 16:59:31.896075 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:31.942689 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7c8c2265-5e45-4c23-b368-8c495a9fe2c1 req-a284638e-9223-430a-bfe2-5c9810b27589 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0937264 Sep 01 16:59:31.968983 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:31.998790 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:31.999942 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:32.000577 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:32.074414 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.5776772 Sep 01 16:59:32.075128 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53170) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:32.075217 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7398e14-c1c0-4cfc-b8bb-24cd5881c58d admin admin] Pushing event updated for resources: {'Network': ['ID=ab951243-4254-4532-9d93-c294f4a98543,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:32.080698 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-512f181c-7bbb-4f91-97ec-d15b737cbc20 admin admin] Request body: {'subnet': {'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-788092363-subnet', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'ip_version': 4}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:59:32.086441 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network ab951243-4254-4532-9d93-c294f4a98543 details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 16:59:32.106217 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-512f181c-7bbb-4f91-97ec-d15b737cbc20 admin admin] Made reservation on behalf of ccf739a17862469f9bbcedc5abe17cd1 for: {'subnet': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:59:32.109257 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-512f181c-7bbb-4f91-97ec-d15b737cbc20 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5120093'] for subnet, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:32.350358 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-512f181c-7bbb-4f91-97ec-d15b737cbc20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7343016', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5120075'] for subnet, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:32.441667 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-512f181c-7bbb-4f91-97ec-d15b737cbc20 admin admin] Pushing event updated for resources: {'Subnet': ['ID=eda7763d-791a-46fa-8a76-190c2898271d,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:32.459023 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-512f181c-7bbb-4f91-97ec-d15b737cbc20 admin admin] Checking segment: {'id': 'bd15a57e-34c6-42ac-abbb-bea94ad6f705', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:59:32.459388 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-512f181c-7bbb-4f91-97ec-d15b737cbc20 admin admin] Network hostable DHCP agents. Network: ab951243-4254-4532-9d93-c294f4a98543, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93835) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 16:59:32.479337 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-512f181c-7bbb-4f91-97ec-d15b737cbc20 admin admin] Network ab951243-4254-4532-9d93-c294f4a98543 is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93835) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 16:59:32.497903 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-512f181c-7bbb-4f91-97ec-d15b737cbc20 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, ab951243-4254-4532-9d93-c294f4a98543) {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:59:32.504391 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-512f181c-7bbb-4f91-97ec-d15b737cbc20 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:32.505220 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-512f181c-7bbb-4f91-97ec-d15b737cbc20 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:32.509685 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37a27f25-d2f1-47ec-850d-fec874fb6655 None None] Network ab951243-4254-4532-9d93-c294f4a98543 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:59:32.541554 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53194) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:32.542823 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-512f181c-7bbb-4f91-97ec-d15b737cbc20 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.4655685 Sep 01 16:59:32.546842 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:59:32.581770 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1827089', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4631'] for router, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:32.584068 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1833975', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1833092', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1830247', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4608'] for router, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:32.645126 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device ecc1fde7-837e-4490-b1f8-93b04ddaab48 no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 16:59:32.645620 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:32.677984 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: ecc1fde7-837e-4490-b1f8-93b04ddaab48 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 16:59:32.678326 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device ecc1fde7-837e-4490-b1f8-93b04ddaab48 not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 16:59:32.750727 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ce91fdb-f9d4-529e-8715-29775a2007ca-ab951243-4254-4532-9d93-c294f4a98543', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'fixed_ips': [{'subnet_id': 'eda7763d-791a-46fa-8a76-190c2898271d'}]}} from dv-cinder-799668-16-iscsi. {{(pid=93837) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 01 16:59:32.751631 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:32.798517 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:32.892004 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.db_base_plugin_common [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Allocated IP 172.20.0.2 (ab951243-4254-4532-9d93-c294f4a98543/eda7763d-791a-46fa-8a76-190c2898271d/16f42807-e8cd-47da-bb02-a97a89b74a3a) {{(pid=93837) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:59:33.010092 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:33.037544 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:33.049468 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Notify callbacks [] for port, precommit_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:33.060371 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Transition to ACTIVE for port object 16f42807-e8cd-47da-bb02-a97a89b74a3a will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:59:33.077603 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Transition to ACTIVE for port object 16f42807-e8cd-47da-bb02-a97a89b74a3a will not be triggered until provisioned by entity DHCP. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:59:33.083468 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:33.129705 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Network ab951243-4254-4532-9d93-c294f4a98543 is already hosted by enough agents. {{(pid=93837) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:59:33.133578 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.base_scheduler [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Resources bound (agent type, host, resource id): {{(pid=93837) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:59:33.136733 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Received port after_create {{(pid=93837) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:59:33.138805 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Pushing event updated for resources: {'Port': ['ID=16f42807-e8cd-47da-bb02-a97a89b74a3a,revision_number=1']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:33.147254 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91cd35b-a95a-4a68-aa42-e2eea16fa9e9 req-b3e313eb-fe85-4c6e-b576-0d1f8d8e567c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:33.149046 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a91cd35b-a95a-4a68-aa42-e2eea16fa9e9 req-b3e313eb-fe85-4c6e-b576-0d1f8d8e567c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.1130188 Sep 01 16:59:33.149929 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:33.150289 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:33.152242 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:33.152242 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:33.152571 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:33.152906 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:33.153247 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:33.153578 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:33.153950 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:33.154246 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:33.154619 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:33.154871 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:33.204616 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Attempting to bind port 16f42807-e8cd-47da-bb02-a97a89b74a3a on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:59:33.204987 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Attempting to bind port 16f42807-e8cd-47da-bb02-a97a89b74a3a by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': 'bd15a57e-34c6-42ac-abbb-bea94ad6f705', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:59:33.205406 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Attempting to bind port 16f42807-e8cd-47da-bb02-a97a89b74a3a on network ab951243-4254-4532-9d93-c294f4a98543 {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:59:33.210463 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 59, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:59:33.210839 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Checking segment: {'id': 'bd15a57e-34c6-42ac-abbb-bea94ad6f705', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:59:33.211480 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:33.211625 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Bound using segment: {'id': 'bd15a57e-34c6-42ac-abbb-bea94ad6f705', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:59:33.212088 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Bound port: 16f42807-e8cd-47da-bb02-a97a89b74a3a, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bd15a57e-34c6-42ac-abbb-bea94ad6f705', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:59:33.212490 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:33.223009 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Allocated IP 172.27.1.19 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/a4a1a622-487f-4052-a386-30130de5442b) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:59:33.227799 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a91cd35b-a95a-4a68-aa42-e2eea16fa9e9 req-7a2945ea-580d-46c3-b3d7-3a71983cccea tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539198 Sep 01 16:59:33.287164 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] For port 16f42807-e8cd-47da-bb02-a97a89b74a3a, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:59:33.290824 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] For port 16f42807-e8cd-47da-bb02-a97a89b74a3a, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=16f42807-e8cd-47da-bb02-a97a89b74a3a,segment=NetworkSegment(bd15a57e-34c6-42ac-abbb-bea94ad6f705),segment_id=bd15a57e-34c6-42ac-abbb-bea94ad6f705)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:59:33.295498 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:33.340261 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:33.353232 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cde83ae-6323-46cc-b7b7-59b090dbbfa2 None None] Pushing event updated for resources: {'Port': ['ID=16f42807-e8cd-47da-bb02-a97a89b74a3a,revision_number=2']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:33.387368 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:33.430225 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:59:33.435910 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:59:33.439575 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:59:33.481632 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Pushing event updated for resources: {'Port': ['ID=a4a1a622-487f-4052-a386-30130de5442b,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:33.719471 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:33.857011 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53230) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:33.912863 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_v2 [None req-8bcbee02-2b42-4295-a15e-eac2973ee557 admin admin] Deleting subnet 9b4a4924-07f0-4c55-a14a-c9f863402ba1 {{(pid=93835) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 16:59:33.916777 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8bcbee02-2b42-4295-a15e-eac2973ee557 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:33.954956 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8bcbee02-2b42-4295-a15e-eac2973ee557 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8197692'] for subnet, precommit_delete_associations {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:33.998357 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8bcbee02-2b42-4295-a15e-eac2973ee557 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.062974 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8bcbee02-2b42-4295-a15e-eac2973ee557 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7342711', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5120114'] for subnet, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.076069 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8bcbee02-2b42-4295-a15e-eac2973ee557 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.080933 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-8bcbee02-2b42-4295-a15e-eac2973ee557 admin admin] 10.222.0.67 "DELETE /v2.0/subnets/9b4a4924-07f0-4c55-a14a-c9f863402ba1 HTTP/1.1" status: 204 len: 168 time: 0.2198684 Sep 01 16:59:34.081277 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53232) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:34.096753 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bcbee02-2b42-4295-a15e-eac2973ee557 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9b4a4924-07f0-4c55-a14a-c9f863402ba1,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:34.196129 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.218379 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1833934', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1833207'] for router, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.324559 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 16f42807-e8cd-47da-bb02-a97a89b74a3a up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:34.370067 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.386237 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 16f42807-e8cd-47da-bb02-a97a89b74a3a completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:59:34.403497 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=93836) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:59:34.403884 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=93836) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:59:34.404729 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=93836) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:59:34.405086 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Subscribe: > port after_create 55550000 {{(pid=93836) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:59:34.405466 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Subscribe: > port after_delete 55550000 {{(pid=93836) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:59:34.405809 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Subscribe: > port after_update 55550000 {{(pid=93836) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:59:34.406137 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=93836) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:59:34.406463 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=93836) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:59:34.406788 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=93836) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:59:34.407165 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=93836) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:59:34.469787 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d38c4fc1-9825-4bd6-bf06-b2e3d292f145 None None] Network ab951243-4254-4532-9d93-c294f4a98543 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:59:34.498481 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=93836) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:59:34.498953 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=93836) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:59:34.499358 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=93836) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:59:34.499757 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=93836) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 01 16:59:34.500249 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4af50d67-ae76-48e9-804b-cf2e7dc7f714']}} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:34.537737 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e884c04-4920-4a11-9b01-96747ad3b31b None None] Provisioning for port 16f42807-e8cd-47da-bb02-a97a89b74a3a completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:59:34.544865 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2785b39f-9a72-4d03-a737-382dced1c97a') {'for_net_delete': True} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:34.545164 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2785b39f-9a72-4d03-a737-382dced1c97a') {} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:34.550906 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e884c04-4920-4a11-9b01-96747ad3b31b None None] Provisioning complete for port 16f42807-e8cd-47da-bb02-a97a89b74a3a triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:34.551287 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e884c04-4920-4a11-9b01-96747ad3b31b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.566640 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5815145'] for segment, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.605469 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d161751-6628-4f6d-9a78-07e4145aae76 req-2d7f9ad2-ff20-4530-a0a6-f5e5ce28d7cb tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:34.607048 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3d161751-6628-4f6d-9a78-07e4145aae76 req-2d7f9ad2-ff20-4530-a0a6-f5e5ce28d7cb tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.2291317 Sep 01 16:59:34.609205 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.626868 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Releasing vlan 532 on physical network physnet1 to pool {{(pid=93836) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 16:59:34.627299 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6279874'] for segment, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: from cryptography.utils import int_from_bytes Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: from cryptography.utils import int_from_bytes Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: Traceback (most recent call last): Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: timer() Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: cb(*args, **kw) Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: return func(*args, **kwargs) Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: self._notify() Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: self.callback(batched_events) Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: event.method(event) Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: return f(self, *a, **k) Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: return self._get(url).json() Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: return self.request(url, 'GET', **kwargs) Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 16:59:34.631428 dv-cinder-799668-16-iscsi neutron-server[93836]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 16:59:34.705753 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e884c04-4920-4a11-9b01-96747ad3b31b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.717907 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.720770 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Router 13010fed-52ce-4d2e-bd27-6579300a2565 is scheduled to L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c with binding_index 1 {{(pid=93836) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 01 16:59:34.725642 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3d161751-6628-4f6d-9a78-07e4145aae76 req-c54268e7-d9ca-44fc-b9a6-ee2123383fe9 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1102021 Sep 01 16:59:34.733487 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.735099 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] 10.222.0.67 "DELETE /v2.0/networks/4af50d67-ae76-48e9-804b-cf2e7dc7f714 HTTP/1.1" status: 204 len: 168 time: 0.6528313 Sep 01 16:59:34.746572 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6492dbb7-779c-4b9b-aafc-610e92252359 admin admin] Pushing event deleted for resources: {'Network': ['ID=4af50d67-ae76-48e9-804b-cf2e7dc7f714,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:34.750329 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e884c04-4920-4a11-9b01-96747ad3b31b None None] For port 16f42807-e8cd-47da-bb02-a97a89b74a3a, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=16f42807-e8cd-47da-bb02-a97a89b74a3a,segment=NetworkSegment(bd15a57e-34c6-42ac-abbb-bea94ad6f705),segment_id=bd15a57e-34c6-42ac-abbb-bea94ad6f705)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:59:34.756058 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e884c04-4920-4a11-9b01-96747ad3b31b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.815043 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e884c04-4920-4a11-9b01-96747ad3b31b None None] Pushing event updated for resources: {'Port': ['ID=16f42807-e8cd-47da-bb02-a97a89b74a3a,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:34.903878 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 16:59:34.907669 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53246) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:34.917556 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Sync routers for ids ['13010fed-52ce-4d2e-bd27-6579300a2565'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 16:59:34.933499 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Routers {'13010fed-52ce-4d2e-bd27-6579300a2565'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:59:34.934530 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:59:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['13010fed-52ce-4d2e-bd27-6579300a2565'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:34.950731 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] Notify callbacks [] for router, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:34.951986 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-dc2f9105-e86f-41d1-ae89-efcdcd9cb64f admin admin] 10.222.0.67 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 2.4087729 Sep 01 16:59:34.954826 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53250) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:34.969437 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-08fbf4ec-23ab-466a-af52-40a6d814e20e admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=76cfc4ed03034fdc9e2ce4a3580959f7&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0580850 Sep 01 16:59:34.969718 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53252) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:35.041349 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-28684eeb-9479-44e9-804f-f634eb04b08a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:35.064511 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Set router 13010fed-52ce-4d2e-bd27-6579300a2565 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:59:35.086405 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-28684eeb-9479-44e9-804f-f634eb04b08a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:35.091675 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-fccb901f-2a9d-498f-8bde-6a170d0b1a80 None None] Provisioning complete for port 16f42807-e8cd-47da-bb02-a97a89b74a3a triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:35.092302 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-fccb901f-2a9d-498f-8bde-6a170d0b1a80 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:35.170653 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-28684eeb-9479-44e9-804f-f634eb04b08a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:35.177170 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-28684eeb-9479-44e9-804f-f634eb04b08a admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:35.180728 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-28684eeb-9479-44e9-804f-f634eb04b08a admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/edb52b36-a4c0-45b6-aa6e-81d4764b67ef HTTP/1.1" status: 204 len: 168 time: 0.2076914 Sep 01 16:59:35.211598 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28684eeb-9479-44e9-804f-f634eb04b08a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=edb52b36-a4c0-45b6-aa6e-81d4764b67ef,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:35.350599 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19'}], 'enable_snat': True}, 'gw_port_id': 'a4a1a622-487f-4052-a386-30130de5442b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T16:59:33Z', 'revision_number': 3, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port': {'id': 'a4a1a622-487f-4052-a386-30130de5442b', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:88:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:33Z', 'updated_at': '2021-09-01T16:59:33Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:35.382240 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Checking router: 13010fed-52ce-4d2e-bd27-6579300a2565 for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 16:59:35.382590 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Updating router 13010fed-52ce-4d2e-bd27-6579300a2565 port a4a1a622-487f-4052-a386-30130de5442b binding host dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 16:59:35.409966 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:35.722176 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Notify callbacks [] for port, precommit_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:35.734531 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.provisioning_blocks [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Transition to ACTIVE for port object a4a1a622-487f-4052-a386-30130de5442b will not be triggered until provisioned by entity L2. {{(pid=93838) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:59:35.744468 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:35.789667 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Attempting to bind port a4a1a622-487f-4052-a386-30130de5442b on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:59:35.790056 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Attempting to bind port a4a1a622-487f-4052-a386-30130de5442b by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:59:35.790422 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Attempting to bind port a4a1a622-487f-4052-a386-30130de5442b on network e28b8145-06a4-43a8-a9f2-9a7014f96a23 {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:59:35.803269 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 59, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:59:35.803650 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Checking segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93838) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:59:35.804235 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:35.804898 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Bound using segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:59:35.805546 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Bound port: a4a1a622-487f-4052-a386-30130de5442b, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:59:35.806038 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:35.820441 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:35.837675 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35681020-2788-4692-b70b-9076a7991d2e None None] Pushing event updated for resources: {'Port': ['ID=a4a1a622-487f-4052-a386-30130de5442b,revision_number=2']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:35.876645 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] For port a4a1a622-487f-4052-a386-30130de5442b, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93838) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:59:35.882447 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] For port a4a1a622-487f-4052-a386-30130de5442b, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=a4a1a622-487f-4052-a386-30130de5442b,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93838) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:59:35.887131 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35681020-2788-4692-b70b-9076a7991d2e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:35.887496 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35681020-2788-4692-b70b-9076a7991d2e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:35.888024 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35681020-2788-4692-b70b-9076a7991d2e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:35.888382 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35681020-2788-4692-b70b-9076a7991d2e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:35.888712 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35681020-2788-4692-b70b-9076a7991d2e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:35.889047 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35681020-2788-4692-b70b-9076a7991d2e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:35.889579 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35681020-2788-4692-b70b-9076a7991d2e None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:35.890079 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35681020-2788-4692-b70b-9076a7991d2e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:35.890606 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35681020-2788-4692-b70b-9076a7991d2e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:35.891091 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35681020-2788-4692-b70b-9076a7991d2e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:35.891581 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35681020-2788-4692-b70b-9076a7991d2e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:35.892068 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35681020-2788-4692-b70b-9076a7991d2e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 16:59:35.896061 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:35.902099 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f66c5c7-3f8b-40ef-8294-52dc5e45cf7c req-70e029a6-171a-498f-89e1-8ad683f20d9b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:35.909620 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3f66c5c7-3f8b-40ef-8294-52dc5e45cf7c req-70e029a6-171a-498f-89e1-8ad683f20d9b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0629561 Sep 01 16:59:35.953516 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3f66c5c7-3f8b-40ef-8294-52dc5e45cf7c req-0caa7c76-c348-4178-a881-a72a569a54c9 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427833 Sep 01 16:59:35.969487 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Routers {'13010fed-52ce-4d2e-bd27-6579300a2565'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:59:35.970653 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:59:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['13010fed-52ce-4d2e-bd27-6579300a2565'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:36.062034 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35681020-2788-4692-b70b-9076a7991d2e None None] Pushing event updated for resources: {'Port': ['ID=a4a1a622-487f-4052-a386-30130de5442b,revision_number=3']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:36.083672 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Allocated IP 172.20.0.1 (ab951243-4254-4532-9d93-c294f4a98543/eda7763d-791a-46fa-8a76-190c2898271d/21fd7876-56d5-4a25-811b-f3b09625dc9b) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:59:36.095060 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] Set router 13010fed-52ce-4d2e-bd27-6579300a2565 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:59:36.207848 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:36.236465 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Transition to ACTIVE for port object 21fd7876-56d5-4a25-811b-f3b09625dc9b will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:59:36.296835 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:36.311625 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 16f42807-e8cd-47da-bb02-a97a89b74a3a up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:36.342601 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Network ab951243-4254-4532-9d93-c294f4a98543 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:59:36.345987 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:59:36.352138 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:59:36.397074 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 16f42807-e8cd-47da-bb02-a97a89b74a3a triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:36.398661 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:36.441055 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Pushing event updated for resources: {'Port': ['ID=21fd7876-56d5-4a25-811b-f3b09625dc9b,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:36.454010 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1827972'] for router_interface, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:36.459237 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19'}], 'enable_snat': True}, 'gw_port_id': 'a4a1a622-487f-4052-a386-30130de5442b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T16:59:33Z', 'revision_number': 3, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port': {'id': 'a4a1a622-487f-4052-a386-30130de5442b', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:88:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:33Z', 'updated_at': '2021-09-01T16:59:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:36.512615 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11050518-6c17-4df3-a248-df97ce55c0ec None None] The sync data for ids ['13010fed-52ce-4d2e-bd27-6579300a2565'] in dv-cinder-799668-16-iscsi is: [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19'}], 'enable_snat': True}, 'gw_port_id': 'a4a1a622-487f-4052-a386-30130de5442b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T16:59:33Z', 'revision_number': 3, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port': {'id': 'a4a1a622-487f-4052-a386-30130de5442b', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:88:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:33Z', 'updated_at': '2021-09-01T16:59:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 16:59:36.725232 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:36.737339 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-ab405d71-1537-46ec-b854-a5735ed7d29b None None] Provisioning for port 21fd7876-56d5-4a25-811b-f3b09625dc9b completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:59:36.741505 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-ab405d71-1537-46ec-b854-a5735ed7d29b None None] Provisioning complete for port 21fd7876-56d5-4a25-811b-f3b09625dc9b triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:36.742034 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-ab405d71-1537-46ec-b854-a5735ed7d29b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:36.796263 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-ab405d71-1537-46ec-b854-a5735ed7d29b None None] Port 21fd7876-56d5-4a25-811b-f3b09625dc9b cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 16:59:36.956870 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:36.962134 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:37.054240 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611336', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1832500'] for router_interface, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:37.067419 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Pushing event updated for resources: {'Port': ['ID=21fd7876-56d5-4a25-811b-f3b09625dc9b,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:37.117429 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0010cfdd-284a-4ea9-90ce-a5e7af8b03e9 req-0789eea1-32ad-4eb9-a1eb-9549587ec51a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:37.120581 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0010cfdd-284a-4ea9-90ce-a5e7af8b03e9 req-0789eea1-32ad-4eb9-a1eb-9549587ec51a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0923593 Sep 01 16:59:37.178479 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0010cfdd-284a-4ea9-90ce-a5e7af8b03e9 req-b9f839c0-e583-4cc2-b280-a3d95798f234 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507743 Sep 01 16:59:37.185828 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Network ab951243-4254-4532-9d93-c294f4a98543 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:59:37.187493 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:59:37.408742 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Router 13010fed-52ce-4d2e-bd27-6579300a2565 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 16:59:37.439863 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-eed8a254-bd85-45ff-b4c1-50cd87f72106 None None] Provisioning complete for port 21fd7876-56d5-4a25-811b-f3b09625dc9b triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:37.440458 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-eed8a254-bd85-45ff-b4c1-50cd87f72106 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:37.503082 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-eed8a254-bd85-45ff-b4c1-50cd87f72106 None None] Port 21fd7876-56d5-4a25-811b-f3b09625dc9b cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 16:59:37.565612 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 16:59:37.580296 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-d6e03eaa-3ae9-4d63-9d81-1a2bd465793a admin admin] 10.222.0.67 "PUT /v2.0/routers/13010fed-52ce-4d2e-bd27-6579300a2565/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6154234 Sep 01 16:59:38.261350 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53396) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:38.267186 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1290241884-network', 'tenant_id': '8fa8dccb9985461580f5d9012c082132'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:59:38.298033 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] Made reservation on behalf of 8fa8dccb9985461580f5d9012c082132 for: {'network': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:59:38.300312 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:38.313513 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:38.384032 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device a4a1a622-487f-4052-a386-30130de5442b up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:38.396765 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ae4549-1184-440c-9f3e-176929a9d333 req-f4c81173-5be0-4ee2-b316-1bc6b14cd677 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:38.398363 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-77ae4549-1184-440c-9f3e-176929a9d333 req-f4c81173-5be0-4ee2-b316-1bc6b14cd677 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0876148 Sep 01 16:59:38.476065 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port a4a1a622-487f-4052-a386-30130de5442b completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:59:38.483926 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-77ae4549-1184-440c-9f3e-176929a9d333 req-25c17b9e-64d1-4108-b350-b10594b84e0c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0733135 Sep 01 16:59:38.487683 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port a4a1a622-487f-4052-a386-30130de5442b triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:38.488070 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:38.521418 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:38.531221 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:38.564046 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] vlan segment allocate from pool success with {'vlan_id': 541, 'physical_network': 'physnet1'} {{(pid=93836) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 16:59:38.567983 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0dd0de6-4a20-44b9-9f95-f26f225a56d9,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:38.589778 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:38.590146 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.segments_db [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] Added segment 72428e8d-7584-4a94-9a11-0d3c34cdfd31 of type vlan for network c3a21dc6-983b-487a-a63a-0f2feddc0dcf Sep 01 16:59:38.598720 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Sync routers for ids ['13010fed-52ce-4d2e-bd27-6579300a2565'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 16:59:38.618574 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Routers {'13010fed-52ce-4d2e-bd27-6579300a2565'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:59:38.619661 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:59:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['13010fed-52ce-4d2e-bd27-6579300a2565'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:38.624281 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:38.647947 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:38.687458 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:38.687881 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port a4a1a622-487f-4052-a386-30130de5442b, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=a4a1a622-487f-4052-a386-30130de5442b,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:59:38.689681 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:38.690938 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:38.693584 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:38.769669 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.5045414 Sep 01 16:59:38.770059 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53436) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:38.776732 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-2453a617-7684-428d-9834-31e21992edd2 admin admin] Request body: {'subnet': {'network_id': 'c3a21dc6-983b-487a-a63a-0f2feddc0dcf', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1290241884-subnet', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'ip_version': 4}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:59:38.799987 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=a4a1a622-487f-4052-a386-30130de5442b,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:38.803964 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7244a98e-f92d-469f-aa95-27e58535071f admin admin] Pushing event updated for resources: {'Network': ['ID=c3a21dc6-983b-487a-a63a-0f2feddc0dcf,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:38.804197 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Set router 13010fed-52ce-4d2e-bd27-6579300a2565 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:59:38.827777 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2453a617-7684-428d-9834-31e21992edd2 admin admin] Made reservation on behalf of 8fa8dccb9985461580f5d9012c082132 for: {'subnet': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:59:38.830297 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2453a617-7684-428d-9834-31e21992edd2 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5120093'] for subnet, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:38.835373 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network c3a21dc6-983b-487a-a63a-0f2feddc0dcf details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 16:59:39.039391 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2453a617-7684-428d-9834-31e21992edd2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7343016', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5120075'] for subnet, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:39.111555 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2453a617-7684-428d-9834-31e21992edd2 admin admin] Checking segment: {'id': '72428e8d-7584-4a94-9a11-0d3c34cdfd31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 541, 'network_id': 'c3a21dc6-983b-487a-a63a-0f2feddc0dcf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:59:39.111941 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2453a617-7684-428d-9834-31e21992edd2 admin admin] Network hostable DHCP agents. Network: c3a21dc6-983b-487a-a63a-0f2feddc0dcf, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93835) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 16:59:39.116250 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2453a617-7684-428d-9834-31e21992edd2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9570c867-4a7a-49d3-90c3-267ccaef1997,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:39.137551 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2453a617-7684-428d-9834-31e21992edd2 admin admin] Network c3a21dc6-983b-487a-a63a-0f2feddc0dcf is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93835) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 16:59:39.148037 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-2453a617-7684-428d-9834-31e21992edd2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, c3a21dc6-983b-487a-a63a-0f2feddc0dcf) {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:59:39.158954 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2453a617-7684-428d-9834-31e21992edd2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:39.159820 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2453a617-7684-428d-9834-31e21992edd2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:39.162137 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f449c3fd-1b92-4d73-a51c-6a53326ddca4 None None] Network c3a21dc6-983b-487a-a63a-0f2feddc0dcf requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:59:39.177062 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-2453a617-7684-428d-9834-31e21992edd2 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.4052594 Sep 01 16:59:39.179838 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53450) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:39.187177 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1290241884-router', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:59:39.240171 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1827089', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4631'] for router, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:39.241264 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1833975', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1833092', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1830247', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4608'] for router, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:39.309105 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:39.349417 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19'}], 'enable_snat': True}, 'gw_port_id': 'a4a1a622-487f-4052-a386-30130de5442b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T16:59:36Z', 'revision_number': 4, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port': {'id': 'a4a1a622-487f-4052-a386-30130de5442b', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:88:54', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:33Z', 'updated_at': '2021-09-01T16:59:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '21fd7876-56d5-4a25-811b-f3b09625dc9b', 'name': '', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'mac_address': 'fa:16:3e:43:12:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:35Z', 'updated_at': '2021-09-01T16:59:36Z', 'revision_number': 2, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'subnets': [{'id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:39.383136 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Checking router: 13010fed-52ce-4d2e-bd27-6579300a2565 for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 16:59:39.383136 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Updating router 13010fed-52ce-4d2e-bd27-6579300a2565 port 21fd7876-56d5-4a25-811b-f3b09625dc9b binding host dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 16:59:39.423858 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:39.444868 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ce91fdb-f9d4-529e-8715-29775a2007ca-c3a21dc6-983b-487a-a63a-0f2feddc0dcf', 'network_id': 'c3a21dc6-983b-487a-a63a-0f2feddc0dcf', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'fixed_ips': [{'subnet_id': '9570c867-4a7a-49d3-90c3-267ccaef1997'}]}} from dv-cinder-799668-16-iscsi. {{(pid=93837) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 01 16:59:39.446024 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:39.464692 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53462) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:39.507427 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:39.628620 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8c313b88-ae65-4d07-baa9-15dfebc911ce admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:39.658934 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94323c75-9da6-41b8-84f5-d6a86039e21a req-cf921627-b239-460b-aadf-b46eeb006fee tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:39.660347 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-94323c75-9da6-41b8-84f5-d6a86039e21a req-cf921627-b239-460b-aadf-b46eeb006fee tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0780902 Sep 01 16:59:39.750107 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-94323c75-9da6-41b8-84f5-d6a86039e21a req-cd3cbd65-9d18-41aa-bbda-dd63767b3731 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773449 Sep 01 16:59:39.785847 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8c313b88-ae65-4d07-baa9-15dfebc911ce admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:39.792184 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8c313b88-ae65-4d07-baa9-15dfebc911ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:39.796368 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.db_base_plugin_common [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Allocated IP 172.20.0.2 (c3a21dc6-983b-487a-a63a-0f2feddc0dcf/9570c867-4a7a-49d3-90c3-267ccaef1997/14a1a85f-f795-4fb9-8d79-ffe40773299c) {{(pid=93837) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:59:39.866143 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-8c313b88-ae65-4d07-baa9-15dfebc911ce admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=a83a9490c7484c01a8f0ac9e0e7da9c6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3977034 Sep 01 16:59:39.866143 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c313b88-ae65-4d07-baa9-15dfebc911ce admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5dff6f8f-4750-41ac-ba37-a428dd0d4456,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:39.868253 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53476) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:39.905200 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:39.929682 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:39.993616 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-20a4628b-90ab-49ae-be61-72c6fd3ceb5d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.013157 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Notify callbacks [] for port, precommit_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.035322 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Transition to ACTIVE for port object 21fd7876-56d5-4a25-811b-f3b09625dc9b will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:59:40.044095 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Notify callbacks [] for port, precommit_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.047930 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.049466 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-20a4628b-90ab-49ae-be61-72c6fd3ceb5d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.092077 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Transition to ACTIVE for port object 14a1a85f-f795-4fb9-8d79-ffe40773299c will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:59:40.100647 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Allocated IP 172.27.1.128 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/ba95da00-5d66-47bb-aebe-7e5a4d9f30e1) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:59:40.151431 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Transition to ACTIVE for port object 14a1a85f-f795-4fb9-8d79-ffe40773299c will not be triggered until provisioned by entity DHCP. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:59:40.171897 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0632b4-0710-422d-8dae-d28e51b1e2c8 None None] Pushing event updated for resources: {'Port': ['ID=21fd7876-56d5-4a25-811b-f3b09625dc9b,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:40.180078 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-20a4628b-90ab-49ae-be61-72c6fd3ceb5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.183604 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-20a4628b-90ab-49ae-be61-72c6fd3ceb5d admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.184862 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-20a4628b-90ab-49ae-be61-72c6fd3ceb5d admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/5dff6f8f-4750-41ac-ba37-a428dd0d4456 HTTP/1.1" status: 204 len: 168 time: 0.3156152 Sep 01 16:59:40.195843 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.206572 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20a4628b-90ab-49ae-be61-72c6fd3ceb5d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5dff6f8f-4750-41ac-ba37-a428dd0d4456,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:40.207969 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Attempting to bind port 21fd7876-56d5-4a25-811b-f3b09625dc9b on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:59:40.208346 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Attempting to bind port 21fd7876-56d5-4a25-811b-f3b09625dc9b by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': 'bd15a57e-34c6-42ac-abbb-bea94ad6f705', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:59:40.208713 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Attempting to bind port 21fd7876-56d5-4a25-811b-f3b09625dc9b on network ab951243-4254-4532-9d93-c294f4a98543 {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:59:40.242481 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 59, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:59:40.242481 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Checking segment: {'id': 'bd15a57e-34c6-42ac-abbb-bea94ad6f705', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:59:40.242481 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.242481 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Bound using segment: {'id': 'bd15a57e-34c6-42ac-abbb-bea94ad6f705', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:59:40.242481 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Bound port: 21fd7876-56d5-4a25-811b-f3b09625dc9b, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bd15a57e-34c6-42ac-abbb-bea94ad6f705', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:59:40.243155 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.265318 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Network c3a21dc6-983b-487a-a63a-0f2feddc0dcf is already hosted by enough agents. {{(pid=93837) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:59:40.297653 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.base_scheduler [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Resources bound (agent type, host, resource id): {{(pid=93837) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:59:40.303480 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Received port after_create {{(pid=93837) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:59:40.305803 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.313475 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Pushing event updated for resources: {'Port': ['ID=14a1a85f-f795-4fb9-8d79-ffe40773299c,revision_number=1']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:40.343419 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device a4a1a622-487f-4052-a386-30130de5442b up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:40.374007 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.420965 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:59:40.423900 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:59:40.426378 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:59:40.462671 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Attempting to bind port 14a1a85f-f795-4fb9-8d79-ffe40773299c on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:59:40.463479 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Attempting to bind port 14a1a85f-f795-4fb9-8d79-ffe40773299c by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '72428e8d-7584-4a94-9a11-0d3c34cdfd31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 541, 'network_id': 'c3a21dc6-983b-487a-a63a-0f2feddc0dcf'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:59:40.463802 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Attempting to bind port 14a1a85f-f795-4fb9-8d79-ffe40773299c on network c3a21dc6-983b-487a-a63a-0f2feddc0dcf {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:59:40.467537 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] For port 21fd7876-56d5-4a25-811b-f3b09625dc9b, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:59:40.470689 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Pushing event updated for resources: {'Port': ['ID=ba95da00-5d66-47bb-aebe-7e5a4d9f30e1,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:40.474552 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] For port 21fd7876-56d5-4a25-811b-f3b09625dc9b, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=21fd7876-56d5-4a25-811b-f3b09625dc9b,segment=NetworkSegment(bd15a57e-34c6-42ac-abbb-bea94ad6f705),segment_id=bd15a57e-34c6-42ac-abbb-bea94ad6f705)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:59:40.476881 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 59, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:59:40.477254 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Checking segment: {'id': '72428e8d-7584-4a94-9a11-0d3c34cdfd31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 541, 'network_id': 'c3a21dc6-983b-487a-a63a-0f2feddc0dcf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:59:40.477675 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.478055 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Bound using segment: {'id': '72428e8d-7584-4a94-9a11-0d3c34cdfd31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 541, 'network_id': 'c3a21dc6-983b-487a-a63a-0f2feddc0dcf'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:59:40.478773 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Bound port: 14a1a85f-f795-4fb9-8d79-ffe40773299c, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '72428e8d-7584-4a94-9a11-0d3c34cdfd31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 541, 'network_id': 'c3a21dc6-983b-487a-a63a-0f2feddc0dcf'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:59:40.479553 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.489743 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.575797 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port a4a1a622-487f-4052-a386-30130de5442b triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:40.576178 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.599110 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53482) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:40.634702 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4c71d60a-d748-455a-8807-7f772c15ce28 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.677718 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Routers {'13010fed-52ce-4d2e-bd27-6579300a2565'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:59:40.678594 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:59:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['13010fed-52ce-4d2e-bd27-6579300a2565'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:40.767246 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0632b4-0710-422d-8dae-d28e51b1e2c8 None None] Pushing event updated for resources: {'Port': ['ID=21fd7876-56d5-4a25-811b-f3b09625dc9b,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:40.809241 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] For port 14a1a85f-f795-4fb9-8d79-ffe40773299c, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:59:40.847636 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4c71d60a-d748-455a-8807-7f772c15ce28 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.848427 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] For port 14a1a85f-f795-4fb9-8d79-ffe40773299c, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=14a1a85f-f795-4fb9-8d79-ffe40773299c,segment=NetworkSegment(72428e8d-7584-4a94-9a11-0d3c34cdfd31),segment_id=72428e8d-7584-4a94-9a11-0d3c34cdfd31)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:59:40.858775 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4c71d60a-d748-455a-8807-7f772c15ce28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.911909 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:40.972327 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-4c71d60a-d748-455a-8807-7f772c15ce28 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=3c991e2663d040209f1ce287249574bd&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3695982 Sep 01 16:59:40.973090 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53496) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:40.976176 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c71d60a-d748-455a-8807-7f772c15ce28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d67fb7df-80e7-44e9-ba98-a72521904d0a,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:41.028565 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-419ad09f-60c4-42c2-a9cc-b1b91e51b907 None None] Pushing event updated for resources: {'Port': ['ID=14a1a85f-f795-4fb9-8d79-ffe40773299c,revision_number=2']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:41.055207 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-42741fe6-e88c-4a1a-a81d-20eee3fd7cd1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:41.092748 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:41.096895 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-42741fe6-e88c-4a1a-a81d-20eee3fd7cd1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:41.111858 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] Set router 13010fed-52ce-4d2e-bd27-6579300a2565 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:59:41.176443 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-42741fe6-e88c-4a1a-a81d-20eee3fd7cd1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:41.178416 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18dfa79b-ab48-4a31-9af3-d7f9d079a27c req-c327af5a-6562-4851-aa82-db4ae6ad45c3 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:41.192142 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-42741fe6-e88c-4a1a-a81d-20eee3fd7cd1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:41.192142 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-42741fe6-e88c-4a1a-a81d-20eee3fd7cd1 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/d67fb7df-80e7-44e9-ba98-a72521904d0a HTTP/1.1" status: 204 len: 168 time: 0.2077191 Sep 01 16:59:41.192578 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-18dfa79b-ab48-4a31-9af3-d7f9d079a27c req-c327af5a-6562-4851-aa82-db4ae6ad45c3 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.1855073 Sep 01 16:59:41.199029 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42741fe6-e88c-4a1a-a81d-20eee3fd7cd1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d67fb7df-80e7-44e9-ba98-a72521904d0a,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:41.298251 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-18dfa79b-ab48-4a31-9af3-d7f9d079a27c req-bc904dd2-bb69-40d9-95e1-aad950f9c5ad tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1096573 Sep 01 16:59:41.490761 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1833934', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1833207'] for router, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:41.602970 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19'}], 'enable_snat': True}, 'gw_port_id': 'a4a1a622-487f-4052-a386-30130de5442b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T16:59:36Z', 'revision_number': 4, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port': {'id': 'a4a1a622-487f-4052-a386-30130de5442b', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:88:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:33Z', 'updated_at': '2021-09-01T16:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '21fd7876-56d5-4a25-811b-f3b09625dc9b', 'name': '', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'mac_address': 'fa:16:3e:43:12:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:35Z', 'updated_at': '2021-09-01T16:59:40Z', 'revision_number': 4, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'subnets': [{'id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:41.635578 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6a5fd46-d381-438c-a754-d7ac4093c086 None None] The sync data for ids ['13010fed-52ce-4d2e-bd27-6579300a2565'] in dv-cinder-799668-16-iscsi is: [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19'}], 'enable_snat': True}, 'gw_port_id': 'a4a1a622-487f-4052-a386-30130de5442b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T16:59:36Z', 'revision_number': 4, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port': {'id': 'a4a1a622-487f-4052-a386-30130de5442b', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:88:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:33Z', 'updated_at': '2021-09-01T16:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '21fd7876-56d5-4a25-811b-f3b09625dc9b', 'name': '', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'mac_address': 'fa:16:3e:43:12:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:35Z', 'updated_at': '2021-09-01T16:59:40Z', 'revision_number': 4, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'subnets': [{'id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 16:59:41.666683 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Router 3c8a9cc5-d161-43ce-bea4-98a58a120590 is scheduled to L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c with binding_index 1 {{(pid=93836) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 01 16:59:41.821490 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 16:59:41.831732 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Sync routers for ids ['3c8a9cc5-d161-43ce-bea4-98a58a120590'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 16:59:41.844808 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] Notify callbacks [] for router, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:41.845043 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Routers {'3c8a9cc5-d161-43ce-bea4-98a58a120590'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:59:41.845043 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:59:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['3c8a9cc5-d161-43ce-bea4-98a58a120590'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:41.845219 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-14dc25f6-5290-41ee-9460-8a545391398e admin admin] 10.222.0.67 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.6621306 Sep 01 16:59:41.847929 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53516) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:42.115053 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Set router 3c8a9cc5-d161-43ce-bea4-98a58a120590 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:59:42.517522 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 21fd7876-56d5-4a25-811b-f3b09625dc9b up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:42.528267 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8278dd12-6545-494f-82c3-714f10d3596d req-e45162e5-e651-43da-a442-135eb12dc7bd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:42.547116 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8278dd12-6545-494f-82c3-714f10d3596d req-e45162e5-e651-43da-a442-135eb12dc7bd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.1141167 Sep 01 16:59:42.617707 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 16:59:42.621040 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8278dd12-6545-494f-82c3-714f10d3596d req-e3cfa7f7-2728-4e4e-b47a-3e61a0aeb705 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670164 Sep 01 16:59:42.632532 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'name': 'tempest-TestMinimumBasicScenario-1290241884-router', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128'}], 'enable_snat': True}, 'gw_port_id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:40Z', 'revision_number': 3, 'project_id': '8fa8dccb9985461580f5d9012c082132', 'gw_port': {'id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:fd:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'device_owner': 'network:router_gateway', 'standard_attr_id': 321, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:40Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:42.643171 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-adf01e92-d7bd-4111-8f12-46e53f9e5af2 None None] Network c3a21dc6-983b-487a-a63a-0f2feddc0dcf requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 16:59:42.709203 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Checking router: 3c8a9cc5-d161-43ce-bea4-98a58a120590 for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 16:59:42.709611 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Updating router 3c8a9cc5-d161-43ce-bea4-98a58a120590 port ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 binding host dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 16:59:42.741559 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 21fd7876-56d5-4a25-811b-f3b09625dc9b completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:59:42.766566 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:42.817406 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 21fd7876-56d5-4a25-811b-f3b09625dc9b triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:42.818115 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:42.872808 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-2ba72cf7-be3b-4658-a6b5-7848cf13a1c9 None None] Provisioning for port 14a1a85f-f795-4fb9-8d79-ffe40773299c completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:59:42.957794 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.018403 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.030208 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port 21fd7876-56d5-4a25-811b-f3b09625dc9b, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=21fd7876-56d5-4a25-811b-f3b09625dc9b,segment=NetworkSegment(bd15a57e-34c6-42ac-abbb-bea94ad6f705),segment_id=bd15a57e-34c6-42ac-abbb-bea94ad6f705)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:59:43.044951 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.046369 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 14a1a85f-f795-4fb9-8d79-ffe40773299c up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:43.215106 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=21fd7876-56d5-4a25-811b-f3b09625dc9b,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:43.239883 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 14a1a85f-f795-4fb9-8d79-ffe40773299c completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:59:43.249998 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 14a1a85f-f795-4fb9-8d79-ffe40773299c triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:43.250375 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.255177 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Notify callbacks [] for port, precommit_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.272964 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.provisioning_blocks [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Transition to ACTIVE for port object ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 will not be triggered until provisioned by entity L2. {{(pid=93838) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:59:43.287498 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.366953 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.387516 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Attempting to bind port ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:59:43.387881 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Attempting to bind port ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:59:43.388251 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Attempting to bind port ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 on network e28b8145-06a4-43a8-a9f2-9a7014f96a23 {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:59:43.398473 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Allocated IP 172.20.0.1 (c3a21dc6-983b-487a-a63a-0f2feddc0dcf/9570c867-4a7a-49d3-90c3-267ccaef1997/a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:59:43.414741 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 59, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:59:43.415230 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Checking segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93838) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:59:43.415920 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.416180 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Bound using segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:59:43.416885 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Bound port: ba95da00-5d66-47bb-aebe-7e5a4d9f30e1, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:59:43.417193 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.431068 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port 14a1a85f-f795-4fb9-8d79-ffe40773299c, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=14a1a85f-f795-4fb9-8d79-ffe40773299c,segment=NetworkSegment(72428e8d-7584-4a94-9a11-0d3c34cdfd31),segment_id=72428e8d-7584-4a94-9a11-0d3c34cdfd31)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:59:43.440438 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.476859 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7409df5c-f9a9-4357-bc9b-03ffe9844d33 None None] Pushing event updated for resources: {'Port': ['ID=ba95da00-5d66-47bb-aebe-7e5a4d9f30e1,revision_number=2']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:43.524044 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=14a1a85f-f795-4fb9-8d79-ffe40773299c,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:43.537486 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] For port ba95da00-5d66-47bb-aebe-7e5a4d9f30e1, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93838) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:59:43.541298 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] For port ba95da00-5d66-47bb-aebe-7e5a4d9f30e1, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=ba95da00-5d66-47bb-aebe-7e5a4d9f30e1,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93838) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:59:43.546471 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.589969 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.602168 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Routers {'3c8a9cc5-d161-43ce-bea4-98a58a120590'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:59:43.602798 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:59:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['3c8a9cc5-d161-43ce-bea4-98a58a120590'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:43.606523 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-2b83a6d8-0280-49cf-98bd-681ed2e8b4b3 None None] Provisioning complete for port 14a1a85f-f795-4fb9-8d79-ffe40773299c triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:43.607036 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-2b83a6d8-0280-49cf-98bd-681ed2e8b4b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.614730 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Transition to ACTIVE for port object a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:59:43.658818 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7409df5c-f9a9-4357-bc9b-03ffe9844d33 None None] Pushing event updated for resources: {'Port': ['ID=ba95da00-5d66-47bb-aebe-7e5a4d9f30e1,revision_number=3']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:43.670571 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.716289 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Network c3a21dc6-983b-487a-a63a-0f2feddc0dcf is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:59:43.719906 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:59:43.723682 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:59:43.729899 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Pushing event updated for resources: {'Port': ['ID=a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:43.786712 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] Set router 3c8a9cc5-d161-43ce-bea4-98a58a120590 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:59:43.795861 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1827972'] for router_interface, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:43.812740 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5ece15-cce5-48eb-8a89-0546dc893c53 req-7614cbc7-995b-428b-9914-2ca7ed6cdea2 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:43.827386 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bb5ece15-cce5-48eb-8a89-0546dc893c53 req-7614cbc7-995b-428b-9914-2ca7ed6cdea2 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0945349 Sep 01 16:59:43.873709 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bb5ece15-cce5-48eb-8a89-0546dc893c53 req-419383eb-5ce1-4ee4-9b05-1f0413be221c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454109 Sep 01 16:59:44.000526 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:44.104831 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-bd53c74b-632d-4547-b7f8-ad0e6f1500d2 None None] Provisioning for port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:59:44.110804 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-bd53c74b-632d-4547-b7f8-ad0e6f1500d2 None None] Provisioning complete for port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:44.111835 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-bd53c74b-632d-4547-b7f8-ad0e6f1500d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:44.170261 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-bd53c74b-632d-4547-b7f8-ad0e6f1500d2 None None] Port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 16:59:44.176557 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'name': 'tempest-TestMinimumBasicScenario-1290241884-router', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128'}], 'enable_snat': True}, 'gw_port_id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:40Z', 'revision_number': 3, 'project_id': '8fa8dccb9985461580f5d9012c082132', 'gw_port': {'id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:fd:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'device_owner': 'network:router_gateway', 'standard_attr_id': 321, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:44.228918 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3efbd023-5d7c-4262-89cd-fa06346d911e None None] The sync data for ids ['3c8a9cc5-d161-43ce-bea4-98a58a120590'] in dv-cinder-799668-16-iscsi is: [{'id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'name': 'tempest-TestMinimumBasicScenario-1290241884-router', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128'}], 'enable_snat': True}, 'gw_port_id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:40Z', 'revision_number': 3, 'project_id': '8fa8dccb9985461580f5d9012c082132', 'gw_port': {'id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:fd:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'device_owner': 'network:router_gateway', 'standard_attr_id': 321, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 16:59:44.282715 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:44.291952 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:44.374224 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 21fd7876-56d5-4a25-811b-f3b09625dc9b up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:44.375320 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Pushing event updated for resources: {'Port': ['ID=a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:44.493787 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 21fd7876-56d5-4a25-811b-f3b09625dc9b triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:44.494930 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:44.604080 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 14a1a85f-f795-4fb9-8d79-ffe40773299c up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:44.657422 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611336', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1832500'] for router_interface, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:44.676699 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 14a1a85f-f795-4fb9-8d79-ffe40773299c triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:44.677420 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:44.766916 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Network c3a21dc6-983b-487a-a63a-0f2feddc0dcf is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:59:44.768435 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:59:44.901299 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Router 3c8a9cc5-d161-43ce-bea4-98a58a120590 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 16:59:45.011268 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-72e2e54d-32a0-43d2-bd5c-e3465322316d None None] Provisioning complete for port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:45.011642 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-72e2e54d-32a0-43d2-bd5c-e3465322316d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:45.038707 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 16:59:45.041735 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acccbecb-fe1f-468a-9752-5ff7e9beacc2 req-a8a7deda-515b-478a-9546-6f100cd6753b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:45.050591 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-acccbecb-fe1f-468a-9752-5ff7e9beacc2 req-a8a7deda-515b-478a-9546-6f100cd6753b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0811119 Sep 01 16:59:45.055049 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-83f78c75-d0c4-4099-b1c0-34eca4ad1853 admin admin] 10.222.0.67 "PUT /v2.0/routers/3c8a9cc5-d161-43ce-bea4-98a58a120590/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2038951 Sep 01 16:59:45.074562 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-72e2e54d-32a0-43d2-bd5c-e3465322316d None None] Port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 16:59:45.101834 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-acccbecb-fe1f-468a-9752-5ff7e9beacc2 req-a0c26a64-c6d5-42a5-a95c-5103c6561e60 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500419 Sep 01 16:59:46.035259 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Sync routers for ids ['3c8a9cc5-d161-43ce-bea4-98a58a120590'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 16:59:46.046772 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Routers {'3c8a9cc5-d161-43ce-bea4-98a58a120590'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:59:46.047630 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:59:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['3c8a9cc5-d161-43ce-bea4-98a58a120590'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:46.196338 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Set router 3c8a9cc5-d161-43ce-bea4-98a58a120590 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:59:46.232117 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49dfa07a-f7ba-4d5d-ad9f-b9f16946a355 req-39329429-5a04-4add-b0d4-83aabb52cd77 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:46.239546 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-49dfa07a-f7ba-4d5d-ad9f-b9f16946a355 req-39329429-5a04-4add-b0d4-83aabb52cd77 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0640221 Sep 01 16:59:46.301184 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-49dfa07a-f7ba-4d5d-ad9f-b9f16946a355 req-91a8505a-a4fd-4a5a-b323-96d7e6c63149 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0605757 Sep 01 16:59:46.367501 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:46.471496 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:59:46.480954 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:46.481329 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:46.539535 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'name': 'tempest-TestMinimumBasicScenario-1290241884-router', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128'}], 'enable_snat': True}, 'gw_port_id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:43Z', 'revision_number': 4, 'project_id': '8fa8dccb9985461580f5d9012c082132', 'gw_port': {'id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:fd:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'device_owner': 'network:router_gateway', 'standard_attr_id': 321, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36', 'name': '', 'network_id': 'c3a21dc6-983b-487a-a63a-0f2feddc0dcf', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'mac_address': 'fa:16:3e:dd:e3:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'device_owner': 'network:router_interface', 'standard_attr_id': 327, 'fixed_ips': [{'subnet_id': '9570c867-4a7a-49d3-90c3-267ccaef1997', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:43Z', 'updated_at': '2021-09-01T16:59:44Z', 'revision_number': 2, 'project_id': '8fa8dccb9985461580f5d9012c082132', 'subnets': [{'id': '9570c867-4a7a-49d3-90c3-267ccaef1997', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:46.567189 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Checking router: 3c8a9cc5-d161-43ce-bea4-98a58a120590 for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 16:59:46.567467 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Updating router 3c8a9cc5-d161-43ce-bea4-98a58a120590 port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 binding host dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 16:59:46.615234 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:46.634151 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:46.679469 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port ba95da00-5d66-47bb-aebe-7e5a4d9f30e1, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=ba95da00-5d66-47bb-aebe-7e5a4d9f30e1,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:59:46.688017 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:46.813875 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=ba95da00-5d66-47bb-aebe-7e5a4d9f30e1,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:46.946165 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Notify callbacks [] for port, precommit_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:46.956601 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Transition to ACTIVE for port object a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:59:46.962207 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.134217 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d95e882-8a0e-4132-88dc-951943d60f8a None None] Pushing event updated for resources: {'Port': ['ID=a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:47.187124 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Attempting to bind port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:59:47.187632 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Attempting to bind port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '72428e8d-7584-4a94-9a11-0d3c34cdfd31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 541, 'network_id': 'c3a21dc6-983b-487a-a63a-0f2feddc0dcf'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:59:47.188008 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Attempting to bind port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 on network c3a21dc6-983b-487a-a63a-0f2feddc0dcf {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:59:47.193536 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 59, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:59:47.194115 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Checking segment: {'id': '72428e8d-7584-4a94-9a11-0d3c34cdfd31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 541, 'network_id': 'c3a21dc6-983b-487a-a63a-0f2feddc0dcf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:59:47.194962 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.195364 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Bound using segment: {'id': '72428e8d-7584-4a94-9a11-0d3c34cdfd31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 541, 'network_id': 'c3a21dc6-983b-487a-a63a-0f2feddc0dcf'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:59:47.195834 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Bound port: a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '72428e8d-7584-4a94-9a11-0d3c34cdfd31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 541, 'network_id': 'c3a21dc6-983b-487a-a63a-0f2feddc0dcf'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:59:47.196217 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.246528 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53662) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:47.269005 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] For port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:59:47.272111 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] For port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36,segment=NetworkSegment(72428e8d-7584-4a94-9a11-0d3c34cdfd31),segment_id=72428e8d-7584-4a94-9a11-0d3c34cdfd31)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:59:47.277328 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.297503 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_v2 [None req-ddeada37-1dcc-472e-a667-f044dbe81d01 admin admin] Deleting subnet 974a699d-c373-4a9b-b6f8-2b466e1f6074 {{(pid=93835) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 16:59:47.301312 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ddeada37-1dcc-472e-a667-f044dbe81d01 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.333839 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Routers {'3c8a9cc5-d161-43ce-bea4-98a58a120590'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 16:59:47.334486 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T16:59:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['3c8a9cc5-d161-43ce-bea4-98a58a120590'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:47.355709 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ddeada37-1dcc-472e-a667-f044dbe81d01 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8197692'] for subnet, precommit_delete_associations {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.382886 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d95e882-8a0e-4132-88dc-951943d60f8a None None] Pushing event updated for resources: {'Port': ['ID=a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:47.399991 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ddeada37-1dcc-472e-a667-f044dbe81d01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.451229 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ab5d19-03a5-4ef3-840c-fca0f2cc8099 req-6a2a9a27-b599-4d38-8833-f3b36dd69ebb tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:47.461629 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-62ab5d19-03a5-4ef3-840c-fca0f2cc8099 req-6a2a9a27-b599-4d38-8833-f3b36dd69ebb tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0804093 Sep 01 16:59:47.487202 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ddeada37-1dcc-472e-a667-f044dbe81d01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7342711', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5120114'] for subnet, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.509307 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ddeada37-1dcc-472e-a667-f044dbe81d01 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.512286 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-ddeada37-1dcc-472e-a667-f044dbe81d01 admin admin] 10.222.0.67 "DELETE /v2.0/subnets/974a699d-c373-4a9b-b6f8-2b466e1f6074 HTTP/1.1" status: 204 len: 168 time: 0.2646892 Sep 01 16:59:47.527590 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-62ab5d19-03a5-4ef3-840c-fca0f2cc8099 req-7530bb64-8799-4e3b-a599-4859b1ffe941 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593417 Sep 01 16:59:47.528172 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53674) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:47.532765 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] Set router 3c8a9cc5-d161-43ce-bea4-98a58a120590 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 16:59:47.549044 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddeada37-1dcc-472e-a667-f044dbe81d01 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=974a699d-c373-4a9b-b6f8-2b466e1f6074,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:47.654206 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9702f9d6-a51c-473c-8e27-33af1fed1a65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.741639 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9702f9d6-a51c-473c-8e27-33af1fed1a65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.752462 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-9702f9d6-a51c-473c-8e27-33af1fed1a65 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['940b3cbc-0267-4c44-814a-a1e84335cc72']}} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:47.767836 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-9702f9d6-a51c-473c-8e27-33af1fed1a65 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '73857864-3ac7-43cb-ad32-4e89a807ad40') {'for_net_delete': True} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:47.768368 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-9702f9d6-a51c-473c-8e27-33af1fed1a65 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '73857864-3ac7-43cb-ad32-4e89a807ad40') {} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:47.781647 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9702f9d6-a51c-473c-8e27-33af1fed1a65 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5815145'] for segment, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.798177 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9702f9d6-a51c-473c-8e27-33af1fed1a65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.804673 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9702f9d6-a51c-473c-8e27-33af1fed1a65 admin admin] Releasing vlan 504 on physical network physnet1 to pool {{(pid=93836) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 16:59:47.805138 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9702f9d6-a51c-473c-8e27-33af1fed1a65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6279874'] for segment, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: Traceback (most recent call last): Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: timer() Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: cb(*args, **kw) Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: return func(*args, **kwargs) Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: self._notify() Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: self.callback(batched_events) Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: event.method(event) Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: return f(self, *a, **k) Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: return self._get(url).json() Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: return self.request(url, 'GET', **kwargs) Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 16:59:47.807162 dv-cinder-799668-16-iscsi neutron-server[93836]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 16:59:47.830644 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'name': 'tempest-TestMinimumBasicScenario-1290241884-router', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128'}], 'enable_snat': True}, 'gw_port_id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:43Z', 'revision_number': 4, 'project_id': '8fa8dccb9985461580f5d9012c082132', 'gw_port': {'id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:fd:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'device_owner': 'network:router_gateway', 'standard_attr_id': 321, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36', 'name': '', 'network_id': 'c3a21dc6-983b-487a-a63a-0f2feddc0dcf', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'mac_address': 'fa:16:3e:dd:e3:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'device_owner': 'network:router_interface', 'standard_attr_id': 327, 'fixed_ips': [{'subnet_id': '9570c867-4a7a-49d3-90c3-267ccaef1997', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:43Z', 'updated_at': '2021-09-01T16:59:47Z', 'revision_number': 4, 'project_id': '8fa8dccb9985461580f5d9012c082132', 'subnets': [{'id': '9570c867-4a7a-49d3-90c3-267ccaef1997', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:47.859380 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46ea2eb6-3f24-4dc6-a55b-04920d427593 None None] The sync data for ids ['3c8a9cc5-d161-43ce-bea4-98a58a120590'] in dv-cinder-799668-16-iscsi is: [{'id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'name': 'tempest-TestMinimumBasicScenario-1290241884-router', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128'}], 'enable_snat': True}, 'gw_port_id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:43Z', 'revision_number': 4, 'project_id': '8fa8dccb9985461580f5d9012c082132', 'gw_port': {'id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:fd:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'device_owner': 'network:router_gateway', 'standard_attr_id': 321, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36', 'name': '', 'network_id': 'c3a21dc6-983b-487a-a63a-0f2feddc0dcf', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'mac_address': 'fa:16:3e:dd:e3:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'device_owner': 'network:router_interface', 'standard_attr_id': 327, 'fixed_ips': [{'subnet_id': '9570c867-4a7a-49d3-90c3-267ccaef1997', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:43Z', 'updated_at': '2021-09-01T16:59:47Z', 'revision_number': 4, 'project_id': '8fa8dccb9985461580f5d9012c082132', 'subnets': [{'id': '9570c867-4a7a-49d3-90c3-267ccaef1997', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 16:59:47.870109 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9702f9d6-a51c-473c-8e27-33af1fed1a65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.876627 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9702f9d6-a51c-473c-8e27-33af1fed1a65 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.878479 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-9702f9d6-a51c-473c-8e27-33af1fed1a65 admin admin] 10.222.0.67 "DELETE /v2.0/networks/940b3cbc-0267-4c44-814a-a1e84335cc72 HTTP/1.1" status: 204 len: 168 time: 0.3493395 Sep 01 16:59:47.881407 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53680) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:47.888161 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9702f9d6-a51c-473c-8e27-33af1fed1a65 admin admin] Pushing event deleted for resources: {'Network': ['ID=940b3cbc-0267-4c44-814a-a1e84335cc72,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:47.947975 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_v2 [None req-97b05802-8848-421b-af8c-c833fc4980eb admin admin] Deleting subnet 2c6977a7-b240-470d-96b9-7c0ae25b66a2 {{(pid=93835) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 16:59:47.951648 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-97b05802-8848-421b-af8c-c833fc4980eb admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:47.999675 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-97b05802-8848-421b-af8c-c833fc4980eb admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8197692'] for subnet, precommit_delete_associations {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.031561 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53684) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:48.063292 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-97b05802-8848-421b-af8c-c833fc4980eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.122994 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-97b05802-8848-421b-af8c-c833fc4980eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7342711', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5120114'] for subnet, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.148452 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97b05802-8848-421b-af8c-c833fc4980eb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2c6977a7-b240-470d-96b9-7c0ae25b66a2,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:48.162704 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-97b05802-8848-421b-af8c-c833fc4980eb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.167120 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-97b05802-8848-421b-af8c-c833fc4980eb admin admin] 10.222.0.67 "DELETE /v2.0/subnets/2c6977a7-b240-470d-96b9-7c0ae25b66a2 HTTP/1.1" status: 204 len: 168 time: 0.2820771 Sep 01 16:59:48.167120 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53688) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:48.179626 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cb4b9107-b932-46d4-aad6-bc26602197d5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.277483 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5d905a9a-0367-41d2-a9c0-e54681a0865c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.396304 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5d905a9a-0367-41d2-a9c0-e54681a0865c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.412760 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-5d905a9a-0367-41d2-a9c0-e54681a0865c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['84dafd1a-6428-413e-960f-2622db1fbcc8']}} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:48.418528 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:48.428658 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-5d905a9a-0367-41d2-a9c0-e54681a0865c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1b7bcfbe-09d0-423f-adfd-28ee178418eb') {'for_net_delete': True} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:48.428964 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-5d905a9a-0367-41d2-a9c0-e54681a0865c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1b7bcfbe-09d0-423f-adfd-28ee178418eb') {} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 16:59:48.446769 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5d905a9a-0367-41d2-a9c0-e54681a0865c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8197639'] for segment, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.457784 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cb4b9107-b932-46d4-aad6-bc26602197d5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.463346 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cb4b9107-b932-46d4-aad6-bc26602197d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.474128 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5d905a9a-0367-41d2-a9c0-e54681a0865c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.483623 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 16:59:48.488088 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:48.488468 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.497927 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5d905a9a-0367-41d2-a9c0-e54681a0865c admin admin] Releasing vlan 515 on physical network physnet1 to pool {{(pid=93835) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 16:59:48.498326 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5d905a9a-0367-41d2-a9c0-e54681a0865c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7342797'] for segment, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: Traceback (most recent call last): Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: timer() Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: cb(*args, **kw) Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: return func(*args, **kwargs) Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: self._notify() Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: self.callback(batched_events) Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: event.method(event) Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: return f(self, *a, **k) Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._get(url).json() Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: return self.request(url, 'GET', **kwargs) Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 16:59:48.500771 dv-cinder-799668-16-iscsi neutron-server[93835]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 16:59:48.519946 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-cb4b9107-b932-46d4-aad6-bc26602197d5 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=8212bd5880024a12ae6a3aa0dbc6b18e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4845982 Sep 01 16:59:48.520322 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53690) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:48.561688 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb4b9107-b932-46d4-aad6-bc26602197d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b11d806-ef85-4c9d-8fa8-1acd4a4c5fe1,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:48.586797 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3b37f71c-3406-4776-bff1-9445192ff395 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.590735 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.610251 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5d905a9a-0367-41d2-a9c0-e54681a0865c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.618507 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3b37f71c-3406-4776-bff1-9445192ff395 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.641506 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36,segment=NetworkSegment(72428e8d-7584-4a94-9a11-0d3c34cdfd31),segment_id=72428e8d-7584-4a94-9a11-0d3c34cdfd31)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 16:59:48.646919 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.648284 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:48.682371 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5d905a9a-0367-41d2-a9c0-e54681a0865c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.684519 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-5d905a9a-0367-41d2-a9c0-e54681a0865c admin admin] 10.222.0.67 "DELETE /v2.0/networks/84dafd1a-6428-413e-960f-2622db1fbcc8 HTTP/1.1" status: 204 len: 168 time: 0.5165880 Sep 01 16:59:48.685690 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d905a9a-0367-41d2-a9c0-e54681a0865c admin admin] Pushing event deleted for resources: {'Network': ['ID=84dafd1a-6428-413e-960f-2622db1fbcc8,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:48.761412 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3b37f71c-3406-4776-bff1-9445192ff395 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.764945 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3b37f71c-3406-4776-bff1-9445192ff395 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.766234 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-3b37f71c-3406-4776-bff1-9445192ff395 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/7b11d806-ef85-4c9d-8fa8-1acd4a4c5fe1 HTTP/1.1" status: 204 len: 168 time: 0.2443066 Sep 01 16:59:48.781256 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b37f71c-3406-4776-bff1-9445192ff395 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b11d806-ef85-4c9d-8fa8-1acd4a4c5fe1,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:48.809509 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:48.810173 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:48.815891 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:48.818920 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ab9fd5b-be29-4961-a708-33e9453e1e0a req-14535ffc-1e40-407e-810b-8849d55926da tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:48.828113 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8ab9fd5b-be29-4961-a708-33e9453e1e0a req-14535ffc-1e40-407e-810b-8849d55926da tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.1392910 Sep 01 16:59:48.895115 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8ab9fd5b-be29-4961-a708-33e9453e1e0a req-95cb2696-a8db-480e-aef1-d4e802c5a3d3 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612435 Sep 01 16:59:48.912463 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53704) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:48.984194 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-cc756eda-7e7b-45c7-9a70-12a8ff3f9d39 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=f0cfb9e68822461d8ee9f5d1aa2c1831&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0704641 Sep 01 16:59:48.986907 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53708) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:49.059491 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-0adcc0d7-fd6c-4486-a6b5-4a5a9d685d4a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.089306 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-0adcc0d7-fd6c-4486-a6b5-4a5a9d685d4a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.150670 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-0adcc0d7-fd6c-4486-a6b5-4a5a9d685d4a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.153585 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-0adcc0d7-fd6c-4486-a6b5-4a5a9d685d4a admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.154758 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-0adcc0d7-fd6c-4486-a6b5-4a5a9d685d4a admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/57d0273f-71b0-483b-b16b-2aa8887797f6 HTTP/1.1" status: 204 len: 168 time: 0.1665833 Sep 01 16:59:49.164262 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0adcc0d7-fd6c-4486-a6b5-4a5a9d685d4a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=57d0273f-71b0-483b-b16b-2aa8887797f6,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:49.180275 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53712) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:49.194647 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6458ec4a-420b-42cc-9077-2ea981c79c22 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.296706 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6458ec4a-420b-42cc-9077-2ea981c79c22 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.300698 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6458ec4a-420b-42cc-9077-2ea981c79c22 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.339249 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-6458ec4a-420b-42cc-9077-2ea981c79c22 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=3e8c6882ae90448380a4aed66fcb93d7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1576562 Sep 01 16:59:49.341817 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6458ec4a-420b-42cc-9077-2ea981c79c22 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0340dd30-2c1c-409f-8722-824d8e578ac7,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:49.342380 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53714) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:49.396438 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8ac2542e-94cb-4763-85a4-eddf21c4d3fa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.419516 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8ac2542e-94cb-4763-85a4-eddf21c4d3fa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.470597 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8ac2542e-94cb-4763-85a4-eddf21c4d3fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.473600 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8ac2542e-94cb-4763-85a4-eddf21c4d3fa admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.474699 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-8ac2542e-94cb-4763-85a4-eddf21c4d3fa admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/0340dd30-2c1c-409f-8722-824d8e578ac7 HTTP/1.1" status: 204 len: 168 time: 0.1305203 Sep 01 16:59:49.483744 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ac2542e-94cb-4763-85a4-eddf21c4d3fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0340dd30-2c1c-409f-8722-824d8e578ac7,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:49.584810 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53720) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:49.633284 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-42783aab-1bb3-4492-b461-a926e899d2c6 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=410d0618fa564d0ea16217c3fdf4e81a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0465581 Sep 01 16:59:49.636227 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53722) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:49.689936 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4761577b-fe09-4a5d-858c-e78a7e1bd72c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.714501 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4761577b-fe09-4a5d-858c-e78a7e1bd72c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.769945 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4761577b-fe09-4a5d-858c-e78a7e1bd72c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.772894 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4761577b-fe09-4a5d-858c-e78a7e1bd72c admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:49.779793 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-4761577b-fe09-4a5d-858c-e78a7e1bd72c admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/e2070166-3955-45c7-91c5-73cfc31f6c7c HTTP/1.1" status: 204 len: 168 time: 0.1425257 Sep 01 16:59:49.788813 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4761577b-fe09-4a5d-858c-e78a7e1bd72c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e2070166-3955-45c7-91c5-73cfc31f6c7c,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:50.075144 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b2f899-9655-45f8-8d80-0e2a39cbb104 req-868922c7-65da-4858-befc-0ff7c7a5888a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:50.076968 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b7b2f899-9655-45f8-8d80-0e2a39cbb104 req-868922c7-65da-4858-befc-0ff7c7a5888a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0764625 Sep 01 16:59:50.124000 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b7b2f899-9655-45f8-8d80-0e2a39cbb104 req-783f8d03-20aa-4fb0-9bad-169ead239692 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387175 Sep 01 16:59:50.297289 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 16:59:50.359334 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 16:59:50.359718 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:51.242453 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-42d17862-4906-4975-81a3-bbb1fd873086 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:51.284777 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0899402c-6e74-452a-bc0f-b077d8d48184 req-9e408cf3-a057-4094-97ae-75c10bc8f190 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:51.293613 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0899402c-6e74-452a-bc0f-b077d8d48184 req-9e408cf3-a057-4094-97ae-75c10bc8f190 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0818584 Sep 01 16:59:51.345141 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0899402c-6e74-452a-bc0f-b077d8d48184 req-145011f8-f755-4894-ac85-77aa4564b31e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505571 Sep 01 16:59:51.544323 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-a0f16114-5f57-4032-8bd8-b7c357026f3e tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:51.545840 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-a0f16114-5f57-4032-8bd8-b7c357026f3e tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/networks?id=8331b65a-166e-454c-a3c5-ed861dc82dfc HTTP/1.1" status: 200 len: 814 time: 0.1317911 Sep 01 16:59:51.563162 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-fd7e0088-ef66-4aa3-a565-ca25b5d883f8 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/quotas/7032b30e75954f8da9ad2cb64f1f5ad1 HTTP/1.1" status: 200 len: 375 time: 0.0114057 Sep 01 16:59:51.641999 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-d066e2ae-7f59-4fe8-94d6-05a110d795b6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=7032b30e75954f8da9ad2cb64f1f5ad1&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0720072 Sep 01 16:59:51.696117 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53852) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:51.742270 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-53b8c96c-00d5-48ac-9a7b-926f63b85d8e service neutron] 10.222.0.67 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0993164 Sep 01 16:59:51.867299 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-aa681bfa-1a82-4fc7-b167-1eeeaee5f963 service neutron] 10.222.0.67 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1074109 Sep 01 16:59:51.953099 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-30884025-2f1d-4956-a6c8-db0d7a48a154 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:52.128494 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fc12c6c2-172a-4f92-9985-6d874edf12b5 req-a4666c75-5d2c-4143-b64a-593c8a36615f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 210 time: 0.0383532 Sep 01 16:59:52.184288 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-30884025-2f1d-4956-a6c8-db0d7a48a154 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:52.199265 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-30884025-2f1d-4956-a6c8-db0d7a48a154 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:52.270948 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53882) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:52.271158 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-30884025-2f1d-4956-a6c8-db0d7a48a154 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=a4cbe09167a74af4a8d4578196649583&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5706527 Sep 01 16:59:52.302574 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30884025-2f1d-4956-a6c8-db0d7a48a154 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fbdc43e8-a1bc-4ab4-a9fa-01bf167a0b7a,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:52.423596 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ccfda9f0-e541-4044-a870-599d0ed32cff admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:52.458093 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ccfda9f0-e541-4044-a870-599d0ed32cff admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:52.633592 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ccfda9f0-e541-4044-a870-599d0ed32cff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:52.637189 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ccfda9f0-e541-4044-a870-599d0ed32cff admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:52.638514 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-ccfda9f0-e541-4044-a870-599d0ed32cff admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/fbdc43e8-a1bc-4ab4-a9fa-01bf167a0b7a HTTP/1.1" status: 204 len: 168 time: 0.3667912 Sep 01 16:59:52.652790 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccfda9f0-e541-4044-a870-599d0ed32cff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fbdc43e8-a1bc-4ab4-a9fa-01bf167a0b7a,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:52.674483 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed227c2-5cad-447a-8030-3bee1d0b0459 req-76e0fb52-5aa0-491e-8c7e-519a8422221c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:52.676326 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-aed227c2-5cad-447a-8030-3bee1d0b0459 req-76e0fb52-5aa0-491e-8c7e-519a8422221c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.1454628 Sep 01 16:59:52.820746 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-aed227c2-5cad-447a-8030-3bee1d0b0459 req-dbc0c3ed-a9b6-4837-ab51-d21dcedef366 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1301236 Sep 01 16:59:53.340450 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7f6ddd67-0dac-41b8-928b-a46e8f125736 req-7b786f3a-060e-4e87-94f3-9d083c38730c tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 210 time: 0.0787063 Sep 01 16:59:53.480745 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 53908) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:53.496341 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c33bbae5-2b01-4ac0-8b18-7bd2b85bb02f admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:53.610611 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c33bbae5-2b01-4ac0-8b18-7bd2b85bb02f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:53.617020 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c33bbae5-2b01-4ac0-8b18-7bd2b85bb02f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:53.666130 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c33bbae5-2b01-4ac0-8b18-7bd2b85bb02f admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=8b983c050be64d2bb4ef4abd1892123b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1834099 Sep 01 16:59:53.666933 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33bbae5-2b01-4ac0-8b18-7bd2b85bb02f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6838a7c3-3cd9-4025-b751-b8fb4af0b41d,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:53.668991 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 53912) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:53.757896 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f33e84bf-3041-4337-bcb0-c95abae7f53a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:53.774189 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:53.784393 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-db8062b0-cc3e-481d-bfc9-f39e5d36d48d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:53.826024 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f33e84bf-3041-4337-bcb0-c95abae7f53a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:54.017275 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f33e84bf-3041-4337-bcb0-c95abae7f53a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:54.020168 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f33e84bf-3041-4337-bcb0-c95abae7f53a admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:54.021645 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-f33e84bf-3041-4337-bcb0-c95abae7f53a admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/6838a7c3-3cd9-4025-b751-b8fb4af0b41d HTTP/1.1" status: 204 len: 168 time: 0.3515513 Sep 01 16:59:54.039767 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f33e84bf-3041-4337-bcb0-c95abae7f53a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6838a7c3-3cd9-4025-b751-b8fb4af0b41d,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:54.077101 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a130f450-9c9c-4c81-8e37-75ffb9e53c0a req-bbadfb3a-263e-49b9-8334-1926716032be tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:54.095136 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a130f450-9c9c-4c81-8e37-75ffb9e53c0a req-bbadfb3a-263e-49b9-8334-1926716032be tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.1417928 Sep 01 16:59:54.119464 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-1298ad3e-8edf-4b79-956b-608aa587650b tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:54.122792 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-1298ad3e-8edf-4b79-956b-608aa587650b tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "GET /v2.0/networks?id=8331b65a-166e-454c-a3c5-ed861dc82dfc HTTP/1.1" status: 200 len: 814 time: 0.3207104 Sep 01 16:59:54.149416 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-2b975b85-78e8-41f7-8c93-9fddf08e6299 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Request body: {'port': {'device_id': 'c2a87471-715c-4e53-a840-adaa09346bbf', 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc', 'admin_state_up': True, 'tenant_id': '7032b30e75954f8da9ad2cb64f1f5ad1'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:59:54.215052 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a130f450-9c9c-4c81-8e37-75ffb9e53c0a req-c0fee25b-12d7-4b90-9600-f69b3b5b3a6e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1129234 Sep 01 16:59:54.319002 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-2b975b85-78e8-41f7-8c93-9fddf08e6299 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Made reservation on behalf of 7032b30e75954f8da9ad2cb64f1f5ad1 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 16:59:54.323456 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-2b975b85-78e8-41f7-8c93-9fddf08e6299 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:54.527284 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-63bb7428-87a1-41dc-9c25-8c7d19ffab97 req-2c17cb06-3308-4e9f-bde4-e3791a9d1cb3 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 210 time: 0.0772021 Sep 01 16:59:54.620367 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-2b975b85-78e8-41f7-8c93-9fddf08e6299 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Allocated IP 172.20.0.12 (8331b65a-166e-454c-a3c5-ed861dc82dfc/fd025a14-8839-4451-a03e-bc7daeb612d0/0cf2eaec-e9b1-4ad6-a894-84361c0fe80f) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 16:59:54.860473 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-2b975b85-78e8-41f7-8c93-9fddf08e6299 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:54.891138 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:54.918603 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-2b975b85-78e8-41f7-8c93-9fddf08e6299 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:54.934973 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['3890e11d-5295-488a-9033-9814bb94bf69'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 16:59:54.975891 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-2b975b85-78e8-41f7-8c93-9fddf08e6299 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Network 8331b65a-166e-454c-a3c5-ed861dc82dfc is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 16:59:54.981751 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-2b975b85-78e8-41f7-8c93-9fddf08e6299 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 16:59:54.986175 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-2b975b85-78e8-41f7-8c93-9fddf08e6299 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 16:59:55.020627 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b975b85-78e8-41f7-8c93-9fddf08e6299 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Pushing event updated for resources: {'Port': ['ID=0cf2eaec-e9b1-4ad6-a894-84361c0fe80f,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:55.077732 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-2b975b85-78e8-41f7-8c93-9fddf08e6299 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:55.078590 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-2b975b85-78e8-41f7-8c93-9fddf08e6299 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:55.105612 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-2b975b85-78e8-41f7-8c93-9fddf08e6299 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9642620 Sep 01 16:59:55.127222 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Request body: {'port': {'device_id': 'c2a87471-715c-4e53-a840-adaa09346bbf', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 16:59:55.214921 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:55.486548 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cacade3-b3d2-47b2-ac2d-d10085d0184e req-648bb389-6685-451a-9be4-51b4e3fd6bb6 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:55.488523 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1cacade3-b3d2-47b2-ac2d-d10085d0184e req-648bb389-6685-451a-9be4-51b4e3fd6bb6 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.1167722 Sep 01 16:59:55.604194 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1cacade3-b3d2-47b2-ac2d-d10085d0184e req-fe4b795c-e168-4193-b0bb-487fc5b93e0d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1069283 Sep 01 16:59:55.736522 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 16:59:55.747674 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:55.763816 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Transition to ACTIVE for port object 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 16:59:55.771601 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:55.777982 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04c2cacb-1d3e-4701-bbc7-058e4f1bf114 req-c8636d34-3102-41b6-8940-67cdcf2b3919 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:55.785878 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-04c2cacb-1d3e-4701-bbc7-058e4f1bf114 req-c8636d34-3102-41b6-8940-67cdcf2b3919 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 932 time: 0.1246228 Sep 01 16:59:55.858038 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Pushing event updated for resources: {'Port': ['ID=0cf2eaec-e9b1-4ad6-a894-84361c0fe80f,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:55.868920 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-04c2cacb-1d3e-4701-bbc7-058e4f1bf114 req-41c36ea2-1f74-4600-a2ba-cd8725b98b38 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0724094 Sep 01 16:59:55.937986 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Attempting to bind port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 16:59:55.938518 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Attempting to bind port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 16:59:55.938770 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Attempting to bind port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f on network 8331b65a-166e-454c-a3c5-ed861dc82dfc {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:59:55.943514 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f on network 8331b65a-166e-454c-a3c5-ed861dc82dfc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 16:59:55.943872 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Attempting to bind port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f on network 8331b65a-166e-454c-a3c5-ed861dc82dfc {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 16:59:55.949895 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 16, 59, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 16:59:55.950239 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Checking segment: {'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 16:59:55.950681 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Bound using segment: {'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 16:59:55.951169 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Bound port: 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 16:59:55.951462 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:56.095882 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] For port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 16:59:56.103455 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] For port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=0cf2eaec-e9b1-4ad6-a894-84361c0fe80f,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 16:59:56.111035 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:56.173517 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:56.174035 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:56.175518 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] 10.222.0.69 "PUT /v2.0/ports/0cf2eaec-e9b1-4ad6-a894-84361c0fe80f HTTP/1.1" status: 200 len: 1094 time: 1.0596809 Sep 01 16:59:56.176182 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c2a87471-715c-4e53-a840-adaa09346bbf', 'tag': '0cf2eaec-e9b1-4ad6-a894-84361c0fe80f'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 16:59:56.178266 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d08d81ab-7fb3-4ca0-af45-87cbf6ba2e77" -d '{"events": [{"name": "network-changed", "server_uuid": "c2a87471-715c-4e53-a840-adaa09346bbf", "tag": "0cf2eaec-e9b1-4ad6-a894-84361c0fe80f"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 16:59:56.204039 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddee2977-4861-4d15-8503-7485a5523f79 service neutron] Pushing event updated for resources: {'Port': ['ID=0cf2eaec-e9b1-4ad6-a894-84361c0fe80f,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:56.272736 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 16:59:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-219aa486-6cc9-447e-a61f-307013dfafc2 x-openstack-request-id: req-219aa486-6cc9-447e-a61f-307013dfafc2 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 16:59:56.273149 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c2a87471-715c-4e53-a840-adaa09346bbf", "tag": "0cf2eaec-e9b1-4ad6-a894-84361c0fe80f", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 16:59:56.273483 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-219aa486-6cc9-447e-a61f-307013dfafc2 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 16:59:56.273978 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c2a87471-715c-4e53-a840-adaa09346bbf', 'tag': '0cf2eaec-e9b1-4ad6-a894-84361c0fe80f', 'status': 'completed', 'code': 200} Sep 01 16:59:56.303517 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-f7bbf8af-1fdd-4665-9e47-bd8b3293c59b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:56.305925 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-f7bbf8af-1fdd-4665-9e47-bd8b3293c59b service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7032b30e75954f8da9ad2cb64f1f5ad1&device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 1097 time: 0.0799704 Sep 01 16:59:56.382132 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-9e7ae496-5a3c-401a-8ad7-7bce90fe5b96 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0cf2eaec-e9b1-4ad6-a894-84361c0fe80f HTTP/1.1" status: 200 len: 217 time: 0.0579493 Sep 01 16:59:56.434503 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:56.463027 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-2b7a180c-ae6d-40c8-b69b-69b48b0564a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:56.465029 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-2b7a180c-ae6d-40c8-b69b-69b48b0564a5 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd025a14-8839-4451-a03e-bc7daeb612d0 HTTP/1.1" status: 200 len: 854 time: 0.0685842 Sep 01 16:59:56.521038 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-3fcf94dc-9f41-4805-821e-cc649a016e4c service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8331b65a-166e-454c-a3c5-ed861dc82dfc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0369704 Sep 01 16:59:56.535754 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:56.686527 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-6463c97e-6874-4502-865b-cecd6da0b63b service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1541495 Sep 01 16:59:56.812015 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1dcaed0-aa84-4337-a7c1-6c74bf665939 req-7a579ab7-a05f-4274-abe6-ebb014eb297b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:56.819665 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f1dcaed0-aa84-4337-a7c1-6c74bf665939 req-7a579ab7-a05f-4274-abe6-ebb014eb297b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0956450 Sep 01 16:59:56.860216 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f1dcaed0-aa84-4337-a7c1-6c74bf665939 req-294c3947-2df5-440d-8c4c-589a16f673ed tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382113 Sep 01 16:59:56.945365 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd4bb6be-2e08-4e0f-aa99-575488f6f3d2 req-7c1f5880-42a8-4230-8872-e811f61f3bf7 service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2457552 Sep 01 16:59:57.090489 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e12b11-1085-4838-85d9-0f3084edf514 req-e6505979-25be-4498-92ba-af7500307b7f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:57.100089 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-11e12b11-1085-4838-85d9-0f3084edf514 req-e6505979-25be-4498-92ba-af7500307b7f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 944 time: 0.1075058 Sep 01 16:59:57.169645 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d08d81ab-7fb3-4ca0-af45-87cbf6ba2e77 req-fbc0d0c9-38fd-4bc2-8752-bec38c3bea1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:57.171853 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d08d81ab-7fb3-4ca0-af45-87cbf6ba2e77 req-fbc0d0c9-38fd-4bc2-8752-bec38c3bea1c service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7032b30e75954f8da9ad2cb64f1f5ad1&device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 1097 time: 0.1158993 Sep 01 16:59:57.222674 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-11e12b11-1085-4838-85d9-0f3084edf514 req-3b06f9a5-202a-4584-ba8a-6b180e6eb473 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1183467 Sep 01 16:59:57.333820 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d08d81ab-7fb3-4ca0-af45-87cbf6ba2e77 req-d56b4929-858f-4180-8576-688b8f01f403 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:57.335599 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d08d81ab-7fb3-4ca0-af45-87cbf6ba2e77 req-d56b4929-858f-4180-8576-688b8f01f403 service neutron] 10.222.0.69 "GET /v2.0/networks?id=8331b65a-166e-454c-a3c5-ed861dc82dfc HTTP/1.1" status: 200 len: 915 time: 0.1509252 Sep 01 16:59:57.351455 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d8349ce-2820-4394-8b65-340fec939063 req-238480fa-bacd-4140-97f4-13a15d70e4bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:57.359964 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7d8349ce-2820-4394-8b65-340fec939063 req-238480fa-bacd-4140-97f4-13a15d70e4bf service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 1098 time: 0.0751595 Sep 01 16:59:57.464237 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d08d81ab-7fb3-4ca0-af45-87cbf6ba2e77 req-169ba76f-fba3-4ab6-a59a-62ceae8c7b47 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0cf2eaec-e9b1-4ad6-a894-84361c0fe80f HTTP/1.1" status: 200 len: 217 time: 0.0896864 Sep 01 16:59:57.536093 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7d8349ce-2820-4394-8b65-340fec939063 req-6a173c50-01b8-4f90-8443-352cbc2fe1a2 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1470478 Sep 01 16:59:57.539668 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d08d81ab-7fb3-4ca0-af45-87cbf6ba2e77 req-7edf1613-fa59-4f98-a691-c4911df647ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:57.541423 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d08d81ab-7fb3-4ca0-af45-87cbf6ba2e77 req-7edf1613-fa59-4f98-a691-c4911df647ea service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd025a14-8839-4451-a03e-bc7daeb612d0 HTTP/1.1" status: 200 len: 854 time: 0.0647423 Sep 01 16:59:57.555741 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 54080) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:57.674008 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0940445d-7345-41e1-87f0-a5e2dd15ed28 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:57.775666 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0940445d-7345-41e1-87f0-a5e2dd15ed28 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:57.780092 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0940445d-7345-41e1-87f0-a5e2dd15ed28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:57.826363 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d08d81ab-7fb3-4ca0-af45-87cbf6ba2e77 req-a5e4367f-376f-4b68-b246-33fdf4746f8c service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8331b65a-166e-454c-a3c5-ed861dc82dfc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0298100 Sep 01 16:59:57.836754 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 54088) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:57.837173 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-0940445d-7345-41e1-87f0-a5e2dd15ed28 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=606420a2b2684a8aa9583a3d58c7539a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2801824 Sep 01 16:59:57.839588 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0940445d-7345-41e1-87f0-a5e2dd15ed28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=12edefd5-b848-4005-a0c6-23f62f7d7f19,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:58.019101 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7d5693b9-4f78-4c7c-80b8-ae55741549c2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:58.029080 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d08d81ab-7fb3-4ca0-af45-87cbf6ba2e77 req-e5573216-4bdb-473b-9ba3-5dafeaf56efe service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1819518 Sep 01 16:59:58.039682 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4699e36-92d2-4c56-8caa-3b409549d53c req-fafbd142-3c41-4aac-adbf-ef4069c5211d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:58.045724 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e4699e36-92d2-4c56-8caa-3b409549d53c req-fafbd142-3c41-4aac-adbf-ef4069c5211d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0960937 Sep 01 16:59:58.092287 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7d5693b9-4f78-4c7c-80b8-ae55741549c2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:58.099294 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e4699e36-92d2-4c56-8caa-3b409549d53c req-18d67aba-8e08-46e6-8123-862f60394bfd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481827 Sep 01 16:59:58.226850 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d08d81ab-7fb3-4ca0-af45-87cbf6ba2e77 req-de2ba7e5-6f9f-447b-8f6d-1e18bc0ddbf7 service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1850123 Sep 01 16:59:58.265890 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7d5693b9-4f78-4c7c-80b8-ae55741549c2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:58.270234 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7d5693b9-4f78-4c7c-80b8-ae55741549c2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:58.271482 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-7d5693b9-4f78-4c7c-80b8-ae55741549c2 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/12edefd5-b848-4005-a0c6-23f62f7d7f19 HTTP/1.1" status: 204 len: 168 time: 0.4329560 Sep 01 16:59:58.297686 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d5693b9-4f78-4c7c-80b8-ae55741549c2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=12edefd5-b848-4005-a0c6-23f62f7d7f19,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:58.416459 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3894e09-b9c3-4a79-b185-bb6eeb51376d req-443c1784-5c9f-4433-a40f-a345002088f0 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:58.422942 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c3894e09-b9c3-4a79-b185-bb6eeb51376d req-443c1784-5c9f-4433-a40f-a345002088f0 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 944 time: 0.0915799 Sep 01 16:59:58.547794 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c3894e09-b9c3-4a79-b185-bb6eeb51376d req-9939c88a-c0ae-4d63-8547-6108ff7d1d1e tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1094964 Sep 01 16:59:58.692075 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 54108) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:58.706271 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a61ca109-a9ee-499c-a9b4-022373785f7c admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:58.813833 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a61ca109-a9ee-499c-a9b4-022373785f7c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:58.818259 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a61ca109-a9ee-499c-a9b4-022373785f7c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:58.861426 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a61ca109-a9ee-499c-a9b4-022373785f7c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c6a66e5e-e9a4-4462-ad78-d91ef302b02f,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:58.867013 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-a61ca109-a9ee-499c-a9b4-022373785f7c admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=c54c98f0709744b5940b68b682c017b2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1742065 Sep 01 16:59:58.869912 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 54110) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 16:59:58.938825 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2c1aaaaf-b26a-4597-a66f-6c59e55cd28d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:58.965540 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2c1aaaaf-b26a-4597-a66f-6c59e55cd28d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:59.014977 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2c1aaaaf-b26a-4597-a66f-6c59e55cd28d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:59.017561 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2c1aaaaf-b26a-4597-a66f-6c59e55cd28d admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 16:59:59.018952 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-2c1aaaaf-b26a-4597-a66f-6c59e55cd28d admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/c6a66e5e-e9a4-4462-ad78-d91ef302b02f HTTP/1.1" status: 204 len: 168 time: 0.1479299 Sep 01 16:59:59.027881 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c1aaaaf-b26a-4597-a66f-6c59e55cd28d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c6a66e5e-e9a4-4462-ad78-d91ef302b02f,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 16:59:59.232280 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97205960-4d64-4b6e-a133-e73deded3a4d req-f27a073d-094c-469e-8c4b-69ec4c2239ee tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:59.233974 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-97205960-4d64-4b6e-a133-e73deded3a4d req-f27a073d-094c-469e-8c4b-69ec4c2239ee tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0653198 Sep 01 16:59:59.288149 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-97205960-4d64-4b6e-a133-e73deded3a4d req-84e86074-fba2-4fb7-a434-6e5be4e0b114 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478790 Sep 01 16:59:59.826855 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c8dddd-8d55-45cf-ad72-4d524beb6c90 req-f236bbf3-7a43-449f-b473-3e70e43f08fa tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 16:59:59.839471 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a8c8dddd-8d55-45cf-ad72-4d524beb6c90 req-f236bbf3-7a43-449f-b473-3e70e43f08fa tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 944 time: 0.1722491 Sep 01 16:59:59.897496 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a8c8dddd-8d55-45cf-ad72-4d524beb6c90 req-78502a4c-f826-4542-a073-8fa32b56975f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0550311 Sep 01 17:00:00.446117 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa180418-4858-47bc-b283-af60f19b9163 req-7a094d88-3651-480f-93b2-17f16bbea937 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:00.448211 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-aa180418-4858-47bc-b283-af60f19b9163 req-7a094d88-3651-480f-93b2-17f16bbea937 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0545375 Sep 01 17:00:00.505426 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-aa180418-4858-47bc-b283-af60f19b9163 req-804e48ac-0680-48ae-822d-7022741a1ac0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479550 Sep 01 17:00:00.659009 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3600621-4716-417d-81b7-97bf9cb093e4 req-e49d4bc2-ab2d-45d0-84c3-1ac0a8a34b17 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:00.662844 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f3600621-4716-417d-81b7-97bf9cb093e4 req-e49d4bc2-ab2d-45d0-84c3-1ac0a8a34b17 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0578835 Sep 01 17:00:00.677464 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 54180) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:00.722008 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f3600621-4716-417d-81b7-97bf9cb093e4 req-e2f53b63-20ed-4e35-b892-1aee91b71d42 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0521340 Sep 01 17:00:00.764441 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:00:00.878372 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=0cf2eaec-e9b1-4ad6-a894-84361c0fe80f,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:00.901318 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f1275fe2-2bf8-4bcc-8202-6cb87f13f4a5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:00.918799 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': '0cf2eaec-e9b1-4ad6-a894-84361c0fe80f', 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc', 'port_id': '0cf2eaec-e9b1-4ad6-a894-84361c0fe80f', 'mac_address': 'fa:16:3e:d3:f1:78', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 525, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fd025a14-8839-4451-a03e-bc7daeb612d0', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:00:00.961065 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:00.980707 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:00:01.013553 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=0cf2eaec-e9b1-4ad6-a894-84361c0fe80f,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:01.021340 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:01.096075 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f1275fe2-2bf8-4bcc-8202-6cb87f13f4a5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:01.106849 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f1275fe2-2bf8-4bcc-8202-6cb87f13f4a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:01.133819 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41b323ae-9522-45cc-8ee5-aa84acae4eec req-777dfc2d-2e13-4d6f-8e38-2a3cde90d501 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:01.136225 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-41b323ae-9522-45cc-8ee5-aa84acae4eec req-777dfc2d-2e13-4d6f-8e38-2a3cde90d501 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 944 time: 0.1528633 Sep 01 17:00:01.146829 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=0cf2eaec-e9b1-4ad6-a894-84361c0fe80f,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:01.159923 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-f1275fe2-2bf8-4bcc-8202-6cb87f13f4a5 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=5f75d9eff26c4537af8f6ac047763b83&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4814172 Sep 01 17:00:01.166867 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 54202) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:01.204788 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1275fe2-2bf8-4bcc-8202-6cb87f13f4a5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d0d5dc9-00ce-4ba6-af79-8141ce31d98d,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:01.268781 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-41b323ae-9522-45cc-8ee5-aa84acae4eec req-695013af-3a66-4260-89ea-8eb26952b617 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1159780 Sep 01 17:00:01.270718 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24cf72bf-9adc-4002-b622-c97c716c1f40 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:01.314114 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24cf72bf-9adc-4002-b622-c97c716c1f40 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:01.369675 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24cf72bf-9adc-4002-b622-c97c716c1f40 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:01.372981 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24cf72bf-9adc-4002-b622-c97c716c1f40 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:01.374613 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-24cf72bf-9adc-4002-b622-c97c716c1f40 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/4d0d5dc9-00ce-4ba6-af79-8141ce31d98d HTTP/1.1" status: 204 len: 168 time: 0.2065783 Sep 01 17:00:01.384350 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24cf72bf-9adc-4002-b622-c97c716c1f40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d0d5dc9-00ce-4ba6-af79-8141ce31d98d,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:01.428168 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['0cf2eaec-e9b1-4ad6-a894-84361c0fe80f'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:00:01.451382 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 54212) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:01.585960 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-677c87b5-a1a3-4c09-a819-291d6edbcf84 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:01.727272 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-677c87b5-a1a3-4c09-a819-291d6edbcf84 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:01.732227 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-677c87b5-a1a3-4c09-a819-291d6edbcf84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:01.802773 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-677c87b5-a1a3-4c09-a819-291d6edbcf84 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c4997331-8372-4ce2-87b5-b871da241ce1,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:01.817927 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-677c87b5-a1a3-4c09-a819-291d6edbcf84 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=a5bb8a3d5a1349d589a499eeb8d5cbaf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3650966 Sep 01 17:00:01.819828 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 54224) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:01.898231 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-49335bad-35c9-443d-9894-a2701ab9275a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:01.939927 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-49335bad-35c9-443d-9894-a2701ab9275a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:02.029778 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-49335bad-35c9-443d-9894-a2701ab9275a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:02.043792 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-49335bad-35c9-443d-9894-a2701ab9275a admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:02.053900 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-49335bad-35c9-443d-9894-a2701ab9275a admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/c4997331-8372-4ce2-87b5-b871da241ce1 HTTP/1.1" status: 204 len: 168 time: 0.2292638 Sep 01 17:00:02.073134 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49335bad-35c9-443d-9894-a2701ab9275a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c4997331-8372-4ce2-87b5-b871da241ce1,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:02.527824 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b5ab2c-cba3-42a7-acb7-5063682563ce req-00377883-ed2c-4b38-b480-61a000775677 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:02.536963 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-75b5ab2c-cba3-42a7-acb7-5063682563ce req-00377883-ed2c-4b38-b480-61a000775677 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 945 time: 0.1178744 Sep 01 17:00:02.632075 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-75b5ab2c-cba3-42a7-acb7-5063682563ce req-7b06744a-cb65-4631-a316-6dc382ea64cf tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0865636 Sep 01 17:00:02.668251 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 54266) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:02.700104 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-729f4a7e-44d5-4c5c-9090-89602c2a7cd1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:02.767806 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c2cadb-83cf-4426-843c-5331b9c74728 req-4b1dc256-d91d-4986-a98b-906c27d88f84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:02.769888 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-14c2cadb-83cf-4426-843c-5331b9c74728 req-4b1dc256-d91d-4986-a98b-906c27d88f84 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=4199ca0b18374af7856c19238fc2fea1&device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 1098 time: 0.0834522 Sep 01 17:00:02.779985 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:02.804684 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d09027d9-b281-4efa-89f4-6bf82661db61 req-f92d0608-f2c0-416a-b494-2eb091011863 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:02.806888 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d09027d9-b281-4efa-89f4-6bf82661db61 req-f92d0608-f2c0-416a-b494-2eb091011863 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0878062 Sep 01 17:00:02.894024 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d09027d9-b281-4efa-89f4-6bf82661db61 req-bf273c69-b72a-4a87-9cb0-9a038489107c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0719547 Sep 01 17:00:02.901182 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:02.939006 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:02.939397 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:02.952710 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c2cadb-83cf-4426-843c-5331b9c74728 req-d20703e6-1c10-48cc-bb0c-a2e356443825 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:02.954597 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-14c2cadb-83cf-4426-843c-5331b9c74728 req-d20703e6-1c10-48cc-bb0c-a2e356443825 service neutron] 10.222.0.69 "GET /v2.0/networks?id=63606bb0-66bd-46d6-ba6c-55c6da830865 HTTP/1.1" status: 200 len: 920 time: 0.1672442 Sep 01 17:00:02.956557 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-729f4a7e-44d5-4c5c-9090-89602c2a7cd1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:02.963472 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-729f4a7e-44d5-4c5c-9090-89602c2a7cd1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:03.008093 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-729f4a7e-44d5-4c5c-9090-89602c2a7cd1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26cf5b83-fa57-4281-bd90-8dd9729f49a5,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:03.082789 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-14c2cadb-83cf-4426-843c-5331b9c74728 req-bb8c39ed-e926-440f-8b3d-933abd3eef7e service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e3d13334-c7d0-4f40-a25b-5c27c5f90c65 HTTP/1.1" status: 200 len: 217 time: 0.1158795 Sep 01 17:00:03.085142 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-729f4a7e-44d5-4c5c-9090-89602c2a7cd1 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=51352e88beac4d159445eebe1ff41949&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4155779 Sep 01 17:00:03.085289 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:03.088624 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 54276) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:03.115548 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c2a87471-715c-4e53-a840-adaa09346bbf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0cf2eaec-e9b1-4ad6-a894-84361c0fe80f'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:00:03.118581 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0e85db7d-35a7-4ae5-ba31-03dc0f687614" -d '{"events": [{"server_uuid": "c2a87471-715c-4e53-a840-adaa09346bbf", "name": "network-vif-plugged", "status": "completed", "tag": "0cf2eaec-e9b1-4ad6-a894-84361c0fe80f"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:00:03.138584 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=0cf2eaec-e9b1-4ad6-a894-84361c0fe80f,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:03.154281 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:03.219512 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=0cf2eaec-e9b1-4ad6-a894-84361c0fe80f,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:03.241374 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:00:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7bbe15e-fa47-4aa0-9ac8-86e243d9b5f7 x-openstack-request-id: req-e7bbe15e-fa47-4aa0-9ac8-86e243d9b5f7 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:00:03.241994 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c2a87471-715c-4e53-a840-adaa09346bbf", "name": "network-vif-plugged", "status": "completed", "tag": "0cf2eaec-e9b1-4ad6-a894-84361c0fe80f", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:00:03.242281 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-e7bbe15e-fa47-4aa0-9ac8-86e243d9b5f7 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:00:03.242736 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c2a87471-715c-4e53-a840-adaa09346bbf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0cf2eaec-e9b1-4ad6-a894-84361c0fe80f', 'code': 200} Sep 01 17:00:03.249153 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-15a2405e-3176-4f09-bcaa-ec63e64fb5b7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:03.285587 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-15a2405e-3176-4f09-bcaa-ec63e64fb5b7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:03.322612 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c2cadb-83cf-4426-843c-5331b9c74728 req-0c2a6041-bb35-4570-8646-ae074fd9d17a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:03.324138 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-14c2cadb-83cf-4426-843c-5331b9c74728 req-0c2a6041-bb35-4570-8646-ae074fd9d17a service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd331d5b-40b1-4163-8537-7af4e56f1efd HTTP/1.1" status: 200 len: 859 time: 0.2023363 Sep 01 17:00:03.370033 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-14c2cadb-83cf-4426-843c-5331b9c74728 req-f2ed49d6-ab13-4bd9-bea2-50202eb421a7 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=63606bb0-66bd-46d6-ba6c-55c6da830865&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0287035 Sep 01 17:00:03.396600 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-15a2405e-3176-4f09-bcaa-ec63e64fb5b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:03.399647 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-15a2405e-3176-4f09-bcaa-ec63e64fb5b7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:03.402150 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-15a2405e-3176-4f09-bcaa-ec63e64fb5b7 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/26cf5b83-fa57-4281-bd90-8dd9729f49a5 HTTP/1.1" status: 204 len: 168 time: 0.3124192 Sep 01 17:00:03.869100 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-754ee71a-1e7f-4007-a9ee-e3a4cc8ac5a3 req-897d461f-f5cd-4fd1-ad5c-b917cef44dde tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:03.879860 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-754ee71a-1e7f-4007-a9ee-e3a4cc8ac5a3 req-897d461f-f5cd-4fd1-ad5c-b917cef44dde tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 946 time: 0.0952170 Sep 01 17:00:03.942217 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-754ee71a-1e7f-4007-a9ee-e3a4cc8ac5a3 req-6dfe2ebc-dfef-471c-aec9-ee58d2fca5c8 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557430 Sep 01 17:00:03.971960 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15a2405e-3176-4f09-bcaa-ec63e64fb5b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26cf5b83-fa57-4281-bd90-8dd9729f49a5,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:04.083791 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e51c0e4c-c583-4861-9291-87b99b8dadfd req-e8655b8c-75dc-44e5-992c-b4f553ac08af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:04.085410 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e51c0e4c-c583-4861-9291-87b99b8dadfd req-e8655b8c-75dc-44e5-992c-b4f553ac08af service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 1099 time: 0.1249850 Sep 01 17:00:04.146471 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-14c2cadb-83cf-4426-843c-5331b9c74728 req-becb4f3c-e214-4c78-9943-255e10d504d9 service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7603967 Sep 01 17:00:04.155280 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c003ee-ae23-4ad7-8373-baa78c4f308a req-b42fd933-4b39-49e1-8dda-346b1a162ecd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:04.164449 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-72c003ee-ae23-4ad7-8373-baa78c4f308a req-b42fd933-4b39-49e1-8dda-346b1a162ecd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.1292572 Sep 01 17:00:04.205617 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 54314) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:04.223029 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-72c003ee-ae23-4ad7-8373-baa78c4f308a req-819a8396-a106-4f45-8282-1044ce2c827a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559967 Sep 01 17:00:04.243044 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5ea7115a-b6f3-467c-925c-2874d2d02688 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:04.292432 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-14c2cadb-83cf-4426-843c-5331b9c74728 req-d01dd049-5472-4872-8e4a-c67e426aea48 service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1231368 Sep 01 17:00:04.308815 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e51c0e4c-c583-4861-9291-87b99b8dadfd req-26302026-4db7-47cf-ac74-b6b90925b8a7 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1601136 Sep 01 17:00:04.366777 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5ea7115a-b6f3-467c-925c-2874d2d02688 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:04.371208 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5ea7115a-b6f3-467c-925c-2874d2d02688 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:04.436419 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ea7115a-b6f3-467c-925c-2874d2d02688 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=98f28756-d04b-4526-938e-358d944ac148,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:04.445879 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 54318) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:04.450057 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-5ea7115a-b6f3-467c-925c-2874d2d02688 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=54877ea242f345a686faceab04eab689&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2431133 Sep 01 17:00:04.507125 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cb0c2966-b3eb-4e92-8d31-3fe7f4e919f5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:04.529715 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cb0c2966-b3eb-4e92-8d31-3fe7f4e919f5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:04.586575 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cb0c2966-b3eb-4e92-8d31-3fe7f4e919f5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:04.589485 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cb0c2966-b3eb-4e92-8d31-3fe7f4e919f5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:04.594011 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-cb0c2966-b3eb-4e92-8d31-3fe7f4e919f5 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/98f28756-d04b-4526-938e-358d944ac148 HTTP/1.1" status: 204 len: 168 time: 0.1475253 Sep 01 17:00:04.602124 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb0c2966-b3eb-4e92-8d31-3fe7f4e919f5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=98f28756-d04b-4526-938e-358d944ac148,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:05.165238 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c15bcd-4aea-43bd-a2a7-861415d6332a req-7951e763-afff-44e2-b3e9-ea0494df34ea tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:05.175090 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-57c15bcd-4aea-43bd-a2a7-861415d6332a req-7951e763-afff-44e2-b3e9-ea0494df34ea tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 946 time: 0.1218846 Sep 01 17:00:05.232292 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-57c15bcd-4aea-43bd-a2a7-861415d6332a req-568d06b6-9dcb-4ecb-a30e-b267dbccaf23 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560071 Sep 01 17:00:05.376989 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 54358) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:05.427913 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-263f7521-1ea1-47dc-884a-3b378960e811 req-a6467a4c-05ad-44e5-842c-698ae7c48599 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:05.442074 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-263f7521-1ea1-47dc-884a-3b378960e811 req-a6467a4c-05ad-44e5-842c-698ae7c48599 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0918615 Sep 01 17:00:05.491829 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-263f7521-1ea1-47dc-884a-3b378960e811 req-22798e90-eea6-4559-b687-e68786e96489 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461981 Sep 01 17:00:05.578910 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fbf7fa74-c413-423c-95ad-db5093583b2a admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:05.773223 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fbf7fa74-c413-423c-95ad-db5093583b2a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:05.778468 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fbf7fa74-c413-423c-95ad-db5093583b2a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:05.826578 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-fbf7fa74-c413-423c-95ad-db5093583b2a admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=d6e6883d023048ffa4f4ca01ed11048c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4484487 Sep 01 17:00:05.827441 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbf7fa74-c413-423c-95ad-db5093583b2a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f560c05e-9e78-4180-8056-75bf3fd0beb8,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:05.829163 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 54380) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:05.898024 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7bc77527-62f7-4ec9-819b-3198223506ab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:05.923326 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7bc77527-62f7-4ec9-819b-3198223506ab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:05.988272 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7bc77527-62f7-4ec9-819b-3198223506ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:05.991746 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7bc77527-62f7-4ec9-819b-3198223506ab admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:05.993009 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-7bc77527-62f7-4ec9-819b-3198223506ab admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/f560c05e-9e78-4180-8056-75bf3fd0beb8 HTTP/1.1" status: 204 len: 168 time: 0.1609392 Sep 01 17:00:06.001917 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bc77527-62f7-4ec9-819b-3198223506ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f560c05e-9e78-4180-8056-75bf3fd0beb8,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:06.390553 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48de7ac1-ee02-4ade-b03a-c1716a01a3c5 req-420c2c94-afd2-4b9f-8186-1bf9fd666839 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:06.392339 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-48de7ac1-ee02-4ade-b03a-c1716a01a3c5 req-420c2c94-afd2-4b9f-8186-1bf9fd666839 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 946 time: 0.0878444 Sep 01 17:00:06.455944 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-48de7ac1-ee02-4ade-b03a-c1716a01a3c5 req-6b0c7644-8df6-472a-8632-cea66f9b366f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0564373 Sep 01 17:00:06.735183 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-293d45d4-88fa-4c8a-8dbf-f5067357c00d req-411d13a7-31b0-4014-a5df-edda87d60800 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:06.736697 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-293d45d4-88fa-4c8a-8dbf-f5067357c00d req-411d13a7-31b0-4014-a5df-edda87d60800 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0561342 Sep 01 17:00:06.776504 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-293d45d4-88fa-4c8a-8dbf-f5067357c00d req-58e01fe6-10a6-41cb-9810-d93c622494b9 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332828 Sep 01 17:00:06.961205 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ded56d-283e-4bb6-9734-da684663f988 req-3ebbd487-821b-4b45-9566-5cc2ad523329 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:06.963759 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f4ded56d-283e-4bb6-9734-da684663f988 req-3ebbd487-821b-4b45-9566-5cc2ad523329 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/networks?id=ab951243-4254-4532-9d93-c294f4a98543 HTTP/1.1" status: 200 len: 814 time: 0.1087828 Sep 01 17:00:06.979623 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f4ded56d-283e-4bb6-9734-da684663f988 req-2bdcd367-f395-4b3b-be11-7fc1e3fbb8d7 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/quotas/ccf739a17862469f9bbcedc5abe17cd1 HTTP/1.1" status: 200 len: 375 time: 0.0096564 Sep 01 17:00:07.030218 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f4ded56d-283e-4bb6-9734-da684663f988 req-bbb28fb9-6430-4c53-bc33-ce2631e2c29a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=ccf739a17862469f9bbcedc5abe17cd1&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0451207 Sep 01 17:00:07.126203 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f4ded56d-283e-4bb6-9734-da684663f988 req-34b00840-554e-4dd9-91f2-dd47c82da2fc service neutron] 10.222.0.67 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813465 Sep 01 17:00:07.234818 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f4ded56d-283e-4bb6-9734-da684663f988 req-5fea15ad-2e77-47aa-9c79-38cf1fc3a455 service neutron] 10.222.0.67 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1023026 Sep 01 17:00:07.402980 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-87a3a079-90e5-4e3e-9c8a-1863f1daa682 req-a9b8150b-2bd9-44ab-85b9-45e8a8d7c71d tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 210 time: 0.0264745 Sep 01 17:00:07.590979 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-239e2dcc-0b48-4f38-8577-71ec32f1aab3 req-1fe7dbe1-9b11-432b-8e1c-09ab67f2c7d5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:07.592502 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-239e2dcc-0b48-4f38-8577-71ec32f1aab3 req-1fe7dbe1-9b11-432b-8e1c-09ab67f2c7d5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 946 time: 0.0538955 Sep 01 17:00:07.637177 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-239e2dcc-0b48-4f38-8577-71ec32f1aab3 req-9157bc95-3c54-435d-b7ba-cb69582b122b tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0348663 Sep 01 17:00:07.899872 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c4e96d9-72ac-4a71-98a0-285649335da1 req-d7fd678a-99ad-40ef-b4c5-5ec571eaf6e5 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:07.901818 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9c4e96d9-72ac-4a71-98a0-285649335da1 req-d7fd678a-99ad-40ef-b4c5-5ec571eaf6e5 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0572200 Sep 01 17:00:07.940342 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9c4e96d9-72ac-4a71-98a0-285649335da1 req-9da843f0-ecf8-4a15-8c19-782bbf0809ce tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325632 Sep 01 17:00:08.642098 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-06703bcc-1585-4f30-b700-e9d7dbd9ec52 req-2c2c0e73-e7dd-4dc5-8cbc-2faf146e9f56 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 210 time: 0.0294886 Sep 01 17:00:08.753823 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b64292be-bd04-40e4-be74-ad0ad419a1b3 req-855cfe4b-197a-44b5-a5e5-183ad732c2c0 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:08.755334 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b64292be-bd04-40e4-be74-ad0ad419a1b3 req-855cfe4b-197a-44b5-a5e5-183ad732c2c0 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 946 time: 0.0484049 Sep 01 17:00:08.793402 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b64292be-bd04-40e4-be74-ad0ad419a1b3 req-5d6614c5-60dd-49f6-9f6d-a7495a31efc5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314770 Sep 01 17:00:09.072759 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99359c34-fe7c-4bbe-bc15-ffc3a3de1c8c req-17893a2e-e577-4bf1-a435-399d81b03734 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:09.074325 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-99359c34-fe7c-4bbe-bc15-ffc3a3de1c8c req-17893a2e-e577-4bf1-a435-399d81b03734 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0676417 Sep 01 17:00:09.123499 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-99359c34-fe7c-4bbe-bc15-ffc3a3de1c8c req-3899da26-3d6b-4e8c-8c4e-ff3a3e48f61c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394080 Sep 01 17:00:09.237052 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ded56d-283e-4bb6-9734-da684663f988 req-2034c142-c7b0-4321-85ec-51956763188f tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:09.238869 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f4ded56d-283e-4bb6-9734-da684663f988 req-2034c142-c7b0-4321-85ec-51956763188f tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.69 "GET /v2.0/networks?id=ab951243-4254-4532-9d93-c294f4a98543 HTTP/1.1" status: 200 len: 814 time: 0.1257076 Sep 01 17:00:09.263196 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-f4ded56d-283e-4bb6-9734-da684663f988 req-97e69a95-9b93-4951-9723-7b3177ae650a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Request body: {'port': {'device_id': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'admin_state_up': True, 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:09.420103 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f4ded56d-283e-4bb6-9734-da684663f988 req-97e69a95-9b93-4951-9723-7b3177ae650a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Made reservation on behalf of ccf739a17862469f9bbcedc5abe17cd1 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:00:09.425294 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-f4ded56d-283e-4bb6-9734-da684663f988 req-97e69a95-9b93-4951-9723-7b3177ae650a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:09.581790 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-f4ded56d-283e-4bb6-9734-da684663f988 req-97e69a95-9b93-4951-9723-7b3177ae650a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Allocated IP 172.20.0.7 (ab951243-4254-4532-9d93-c294f4a98543/eda7763d-791a-46fa-8a76-190c2898271d/6f9364de-2626-4bc4-828f-69a19d15adc9) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:00:09.756484 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-48096bce-750b-4a28-996b-789047361073 req-1b975153-04e0-4d81-bb60-6f580989cb15 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 210 time: 0.0307765 Sep 01 17:00:09.830601 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-f4ded56d-283e-4bb6-9734-da684663f988 req-97e69a95-9b93-4951-9723-7b3177ae650a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:09.850123 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-f4ded56d-283e-4bb6-9734-da684663f988 req-97e69a95-9b93-4951-9723-7b3177ae650a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Transition to ACTIVE for port object 6f9364de-2626-4bc4-828f-69a19d15adc9 will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:09.902092 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-f4ded56d-283e-4bb6-9734-da684663f988 req-97e69a95-9b93-4951-9723-7b3177ae650a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:09.975372 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f4ded56d-283e-4bb6-9734-da684663f988 req-97e69a95-9b93-4951-9723-7b3177ae650a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Network ab951243-4254-4532-9d93-c294f4a98543 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:00:09.977846 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-f4ded56d-283e-4bb6-9734-da684663f988 req-97e69a95-9b93-4951-9723-7b3177ae650a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:00:09.982114 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-f4ded56d-283e-4bb6-9734-da684663f988 req-97e69a95-9b93-4951-9723-7b3177ae650a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:00:09.989115 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97e69a95-9b93-4951-9723-7b3177ae650a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event updated for resources: {'Port': ['ID=6f9364de-2626-4bc4-828f-69a19d15adc9,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:10.044219 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ded56d-283e-4bb6-9734-da684663f988 req-97e69a95-9b93-4951-9723-7b3177ae650a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:10.044872 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-f4ded56d-283e-4bb6-9734-da684663f988 req-97e69a95-9b93-4951-9723-7b3177ae650a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:10.060607 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f4ded56d-283e-4bb6-9734-da684663f988 req-97e69a95-9b93-4951-9723-7b3177ae650a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8039613 Sep 01 17:00:10.241231 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a8e9e10-bea9-49df-a886-8e434d3a4cb5 req-6c849966-b039-4229-9453-5e4a3b6d1ea7 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:10.242736 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0a8e9e10-bea9-49df-a886-8e434d3a4cb5 req-6c849966-b039-4229-9453-5e4a3b6d1ea7 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0476084 Sep 01 17:00:10.267107 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-5f1ddcee-bcfd-42dc-80fc-f058015c4f75 None None] Provisioning for port 6f9364de-2626-4bc4-828f-69a19d15adc9 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:10.271026 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-5f1ddcee-bcfd-42dc-80fc-f058015c4f75 None None] Provisioning complete for port 6f9364de-2626-4bc4-828f-69a19d15adc9 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:10.271497 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-5f1ddcee-bcfd-42dc-80fc-f058015c4f75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:10.281953 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0a8e9e10-bea9-49df-a886-8e434d3a4cb5 req-efd3602c-28ba-4f15-95e1-c8c4ba59da79 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328326 Sep 01 17:00:10.310268 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-5f1ddcee-bcfd-42dc-80fc-f058015c4f75 None None] Port 6f9364de-2626-4bc4-828f-69a19d15adc9 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:00:10.882549 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c71e3e-a7a8-4c72-b3ff-77ec6fae3f49 req-73e99cf6-0321-4713-8b18-7071b42eb567 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:10.884579 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-33c71e3e-a7a8-4c72-b3ff-77ec6fae3f49 req-73e99cf6-0321-4713-8b18-7071b42eb567 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0507343 Sep 01 17:00:10.922431 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-33c71e3e-a7a8-4c72-b3ff-77ec6fae3f49 req-60220961-7f81-4d4f-aa55-1343c480c3d5 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319011 Sep 01 17:00:11.396360 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b80cc83-93b5-4c26-9051-f5a10df22d9b req-c71bee63-def3-4738-b4a3-9031059d7d3c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:11.397864 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5b80cc83-93b5-4c26-9051-f5a10df22d9b req-c71bee63-def3-4738-b4a3-9031059d7d3c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0498738 Sep 01 17:00:11.437231 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5b80cc83-93b5-4c26-9051-f5a10df22d9b req-5b417502-e54e-4d5b-9174-8d2dae790c73 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0330391 Sep 01 17:00:12.171749 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7f85d02-7d8c-4831-bd8c-df5b82fc250e req-958bb213-22fc-4d2f-84a4-f4bd3311f45d tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:12.173228 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f7f85d02-7d8c-4831-bd8c-df5b82fc250e req-958bb213-22fc-4d2f-84a4-f4bd3311f45d tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0484316 Sep 01 17:00:12.211704 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f7f85d02-7d8c-4831-bd8c-df5b82fc250e req-c6a834d4-cf8e-4d27-a19c-621bd54e0058 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325294 Sep 01 17:00:12.554734 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95248815-56b7-42b5-94c6-337e366f6775 req-d1fb11d2-f2f5-4496-b12a-ce99ca58b4b3 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:12.557377 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-95248815-56b7-42b5-94c6-337e366f6775 req-d1fb11d2-f2f5-4496-b12a-ce99ca58b4b3 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0538073 Sep 01 17:00:12.594237 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-95248815-56b7-42b5-94c6-337e366f6775 req-7245ec56-477a-4e7a-ad3e-7abeb8822e47 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310326 Sep 01 17:00:13.335814 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b28f7c0-7092-4a48-ac90-bea6ecf1155e req-6a300eca-96b5-48a0-93e0-77cbdecca10a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:13.338693 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8b28f7c0-7092-4a48-ac90-bea6ecf1155e req-6a300eca-96b5-48a0-93e0-77cbdecca10a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0519235 Sep 01 17:00:13.376613 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8b28f7c0-7092-4a48-ac90-bea6ecf1155e req-7e3e8d2c-82bb-4031-b015-657bfaaf077c tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329030 Sep 01 17:00:13.719685 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ff22707-9493-44fa-a196-de0a023f4b80 req-8f615225-be75-4ea4-a11a-2929ea7f1523 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:13.721189 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6ff22707-9493-44fa-a196-de0a023f4b80 req-8f615225-be75-4ea4-a11a-2929ea7f1523 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0517316 Sep 01 17:00:13.768145 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6ff22707-9493-44fa-a196-de0a023f4b80 req-0648d84a-c234-442a-b512-8de0e433a5a9 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398958 Sep 01 17:00:14.496114 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15184c1c-6df2-47c8-9855-9c91bbe40bf2 req-f0c78b11-29b6-4ad4-9433-4ac4a9c3a245 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:14.497745 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-15184c1c-6df2-47c8-9855-9c91bbe40bf2 req-f0c78b11-29b6-4ad4-9433-4ac4a9c3a245 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0546286 Sep 01 17:00:14.538323 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-15184c1c-6df2-47c8-9855-9c91bbe40bf2 req-584be0c1-aac6-4bca-be72-9fc12d61f02e tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0341010 Sep 01 17:00:14.888964 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6bfc830-d7c5-4d0a-a5c0-f8784cdd97ae req-acfa3b41-ac71-4b81-91ee-9ccc0283a226 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:14.890514 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d6bfc830-d7c5-4d0a-a5c0-f8784cdd97ae req-acfa3b41-ac71-4b81-91ee-9ccc0283a226 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0522902 Sep 01 17:00:14.931558 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d6bfc830-d7c5-4d0a-a5c0-f8784cdd97ae req-be5f58da-b8dd-436d-85da-ba931599dce0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0344229 Sep 01 17:00:15.659467 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27d9e9c5-65f7-42ef-b2b7-36af1e94d377 req-d14cb073-1081-463e-8aa8-9958842fc417 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:15.661166 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-27d9e9c5-65f7-42ef-b2b7-36af1e94d377 req-d14cb073-1081-463e-8aa8-9958842fc417 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0528224 Sep 01 17:00:15.700887 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-27d9e9c5-65f7-42ef-b2b7-36af1e94d377 req-78ad2636-255a-45e3-af50-25f94973d252 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0334451 Sep 01 17:00:16.051977 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03424cb2-dc20-47d5-a12e-1fb3b48d0aa4 req-71ccdb90-5329-4663-b2a6-79ddc2a0d8f4 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:16.053780 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-03424cb2-dc20-47d5-a12e-1fb3b48d0aa4 req-71ccdb90-5329-4663-b2a6-79ddc2a0d8f4 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0551949 Sep 01 17:00:16.308054 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-03424cb2-dc20-47d5-a12e-1fb3b48d0aa4 req-00805f24-27db-4832-aff4-7bc1d99a84e4 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2477474 Sep 01 17:00:16.820776 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11dd767b-6ba5-4434-9816-5460ada3aa31 req-ef8dcf35-b01d-4605-ae60-416d19429317 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:16.823130 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-11dd767b-6ba5-4434-9816-5460ada3aa31 req-ef8dcf35-b01d-4605-ae60-416d19429317 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0516515 Sep 01 17:00:16.871041 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-11dd767b-6ba5-4434-9816-5460ada3aa31 req-398d02c5-7a21-4b4a-b130-abc7118d739e tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0352702 Sep 01 17:00:17.432450 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6417a5-8fcf-432b-9fc6-5284086a9623 req-fdf03358-6d47-4b00-862e-c196ef1cb555 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:17.434137 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2e6417a5-8fcf-432b-9fc6-5284086a9623 req-fdf03358-6d47-4b00-862e-c196ef1cb555 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0534136 Sep 01 17:00:17.473287 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2e6417a5-8fcf-432b-9fc6-5284086a9623 req-f8a6d3ba-9d5d-4853-90a1-57727e1ac4c0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328579 Sep 01 17:00:18.008649 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce7a4558-0744-49bc-84cd-0c82694b93ff req-290091ff-a56a-46d2-ae40-21ea87db863f tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:18.010230 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ce7a4558-0744-49bc-84cd-0c82694b93ff req-290091ff-a56a-46d2-ae40-21ea87db863f tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0610039 Sep 01 17:00:18.057722 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ce7a4558-0744-49bc-84cd-0c82694b93ff req-e5f9c8d8-2408-4def-9341-244b878b9835 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413098 Sep 01 17:00:18.594606 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1717f29-e44d-470a-aead-a207947b0a02 req-0f1cfe4f-78c4-4338-9117-cedd50c80d0a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:18.596269 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f1717f29-e44d-470a-aead-a207947b0a02 req-0f1cfe4f-78c4-4338-9117-cedd50c80d0a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0502412 Sep 01 17:00:18.636409 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f1717f29-e44d-470a-aead-a207947b0a02 req-11d89bd6-a8f7-4e25-8aaa-495e1b1bfe80 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0339742 Sep 01 17:00:19.174418 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-107a4273-8f08-4a86-9b30-294600179800 req-f1cc27ef-15f9-4435-bafa-bf75c77023a0 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:19.175896 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-107a4273-8f08-4a86-9b30-294600179800 req-f1cc27ef-15f9-4435-bafa-bf75c77023a0 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0491850 Sep 01 17:00:19.219731 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-107a4273-8f08-4a86-9b30-294600179800 req-d2d5d99e-b39b-4320-832b-ab80fc5749ee tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362527 Sep 01 17:00:19.590787 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:00:19.759529 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac968cd7-01bd-4d33-acf6-f769297c5547 req-ebfb0402-5adc-4c09-9b2f-370ea2dbdbdd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:19.760670 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ac968cd7-01bd-4d33-acf6-f769297c5547 req-ebfb0402-5adc-4c09-9b2f-370ea2dbdbdd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0558856 Sep 01 17:00:19.799613 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ac968cd7-01bd-4d33-acf6-f769297c5547 req-63fd9c97-c787-421b-9cda-7e1fd9fee500 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326223 Sep 01 17:00:20.344278 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c27e15-aec7-477e-991a-31b730e7db69 req-eb1ea395-4737-49e3-ae02-8241f26b3399 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:20.345819 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e0c27e15-aec7-477e-991a-31b730e7db69 req-eb1ea395-4737-49e3-ae02-8241f26b3399 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0521505 Sep 01 17:00:20.386249 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e0c27e15-aec7-477e-991a-31b730e7db69 req-14904303-d8a1-4462-be78-bf6eca9e3267 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342405 Sep 01 17:00:20.914375 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1c10cba-bf2c-48d2-9f45-a8e3e6d7dce1 req-28cbbc09-4231-4953-89be-d8e294f2cd10 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:20.916016 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b1c10cba-bf2c-48d2-9f45-a8e3e6d7dce1 req-28cbbc09-4231-4953-89be-d8e294f2cd10 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0487974 Sep 01 17:00:20.956042 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b1c10cba-bf2c-48d2-9f45-a8e3e6d7dce1 req-0ae1689f-1706-4a83-8bf6-1847361bde4e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0337846 Sep 01 17:00:21.234642 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-82ca29df-87c1-46a3-abb1-fb8060ec546c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:21.505626 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-585553ba-ff5b-4a34-89cc-d3a73c11689e req-7482dcdc-3c1b-4a31-b6ac-71bc2e069aea tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:21.507103 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-585553ba-ff5b-4a34-89cc-d3a73c11689e req-7482dcdc-3c1b-4a31-b6ac-71bc2e069aea tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0528271 Sep 01 17:00:21.544450 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-585553ba-ff5b-4a34-89cc-d3a73c11689e req-6b3572c1-3503-443d-b827-cd648908f265 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312707 Sep 01 17:00:22.088973 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7daba348-e336-487f-8655-0f3ffdcff2d4 req-c74986a0-b406-4360-a4d4-ee55282e10b5 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:22.090654 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7daba348-e336-487f-8655-0f3ffdcff2d4 req-c74986a0-b406-4360-a4d4-ee55282e10b5 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0543454 Sep 01 17:00:22.131374 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7daba348-e336-487f-8655-0f3ffdcff2d4 req-843abe0d-6145-4676-a2cd-5f88e4b8bf8f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329323 Sep 01 17:00:22.684714 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81732022-9249-4dce-8c3d-043c0281c203 req-2fc89752-eb28-47a1-8d57-9a9ec3d527c5 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:22.687479 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-81732022-9249-4dce-8c3d-043c0281c203 req-2fc89752-eb28-47a1-8d57-9a9ec3d527c5 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0619032 Sep 01 17:00:22.728991 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 54764) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:22.765115 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-81732022-9249-4dce-8c3d-043c0281c203 req-584e1e88-442d-4988-8e3c-44be789b2ea8 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698195 Sep 01 17:00:22.864300 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:22.963383 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:22.967412 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:23.006353 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=418b89be-1757-4b7c-b68e-d6975ccc0367,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:23.010830 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=4db8922d9aff4e2084b67f0b44c39b73&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2807512 Sep 01 17:00:23.014105 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 54770) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:23.016938 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.017295 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.017707 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.018049 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.018386 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.018721 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.019053 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.019382 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.019764 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.020096 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.020423 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.020747 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270b75d9-4062-4cdb-897c-49d190e12642 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.081681 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:23.105253 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:23.180660 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:23.183382 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:23.186905 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/418b89be-1757-4b7c-b68e-d6975ccc0367 HTTP/1.1" status: 204 len: 168 time: 0.1692696 Sep 01 17:00:23.193068 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=418b89be-1757-4b7c-b68e-d6975ccc0367,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:23.202904 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.203122 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.203545 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.203938 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.204214 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.204551 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.205577 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.205924 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.206312 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.206647 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.206916 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.207240 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c255ca7b-3c1f-4c63-b98c-8244746dfa4e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:23.359923 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0803ddb-28e7-41d8-9ae8-429b27253e5f req-2b81f5b4-4d96-465f-b5d4-07d4eed69e64 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:23.382158 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e0803ddb-28e7-41d8-9ae8-429b27253e5f req-2b81f5b4-4d96-465f-b5d4-07d4eed69e64 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.1195562 Sep 01 17:00:23.461888 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e0803ddb-28e7-41d8-9ae8-429b27253e5f req-803a677c-6182-4d4c-8a10-f70010c21bce tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748405 Sep 01 17:00:23.793314 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:23.797770 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-281b9583-58e9-487f-b6d8-29c64548dc6a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:23.999072 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a728c79-65d7-4435-bbd7-2c9666d1d06d req-925a102f-ce83-46d9-a68a-3ff15c81cede tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:24.007447 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2a728c79-65d7-4435-bbd7-2c9666d1d06d req-925a102f-ce83-46d9-a68a-3ff15c81cede tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0834370 Sep 01 17:00:24.062869 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2a728c79-65d7-4435-bbd7-2c9666d1d06d req-d53b7cea-bfe7-4a90-8841-57cb35384d92 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535078 Sep 01 17:00:24.250025 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 54822) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:24.365845 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6e0d5bc0-964d-490b-be60-d096dd2d5efe admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:24.464250 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6e0d5bc0-964d-490b-be60-d096dd2d5efe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:24.469296 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6e0d5bc0-964d-490b-be60-d096dd2d5efe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:24.518667 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 54834) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:24.519631 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-6e0d5bc0-964d-490b-be60-d096dd2d5efe admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=8a800b8831b344509abe0c4dfd1eee58&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2676580 Sep 01 17:00:24.519803 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e0d5bc0-964d-490b-be60-d096dd2d5efe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a12281e-2c9a-4acc-942d-2a56cf8053f4,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:24.603259 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f9e2c986-526c-4ddb-8efb-589f7a80d9fe admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:24.627900 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e11241a-afa5-4b9a-a9b6-171b77e6173a req-de9e21d8-f4b5-48b4-bfe6-894464fb2f2a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:24.636802 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0e11241a-afa5-4b9a-a9b6-171b77e6173a req-de9e21d8-f4b5-48b4-bfe6-894464fb2f2a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0684061 Sep 01 17:00:24.639288 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f9e2c986-526c-4ddb-8efb-589f7a80d9fe admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:24.679345 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0e11241a-afa5-4b9a-a9b6-171b77e6173a req-af44732d-6672-45eb-a6b7-c06be72da04e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413537 Sep 01 17:00:24.724626 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f9e2c986-526c-4ddb-8efb-589f7a80d9fe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:24.728086 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 54842) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:24.737370 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f9e2c986-526c-4ddb-8efb-589f7a80d9fe admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:24.741865 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-f9e2c986-526c-4ddb-8efb-589f7a80d9fe admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/4a12281e-2c9a-4acc-942d-2a56cf8053f4 HTTP/1.1" status: 204 len: 168 time: 0.2177875 Sep 01 17:00:24.752057 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9e2c986-526c-4ddb-8efb-589f7a80d9fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a12281e-2c9a-4acc-942d-2a56cf8053f4,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:24.875490 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3fc5a7e7-d413-4319-92b9-5977f0db9331 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:24.922079 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:24.997281 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3fc5a7e7-d413-4319-92b9-5977f0db9331 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:25.003038 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3fc5a7e7-d413-4319-92b9-5977f0db9331 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:25.098069 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-3fc5a7e7-d413-4319-92b9-5977f0db9331 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=f671ea87fbbc46b1832d2edcd9a19b72&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3688123 Sep 01 17:00:25.100836 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 54858) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:25.109346 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc5a7e7-d413-4319-92b9-5977f0db9331 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61327d2f-59df-4636-979f-597e35dc5010,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:25.192732 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-936ba687-4c2f-46d5-bdf1-9b896b4f23c3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:25.213878 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 54862) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:25.222922 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-936ba687-4c2f-46d5-bdf1-9b896b4f23c3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:25.276465 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c847afcf-2abd-4b59-9f81-138881163ebe req-fd438d2a-141e-47cd-a608-cbc05bc9c2eb tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:25.278472 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c847afcf-2abd-4b59-9f81-138881163ebe req-fd438d2a-141e-47cd-a608-cbc05bc9c2eb tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.1094980 Sep 01 17:00:25.350855 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c847afcf-2abd-4b59-9f81-138881163ebe req-7b731afd-3f97-4bb5-8623-9f4b7f604008 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650864 Sep 01 17:00:25.390161 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-936ba687-4c2f-46d5-bdf1-9b896b4f23c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:25.393110 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-936ba687-4c2f-46d5-bdf1-9b896b4f23c3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:25.394562 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-936ba687-4c2f-46d5-bdf1-9b896b4f23c3 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/61327d2f-59df-4636-979f-597e35dc5010 HTTP/1.1" status: 204 len: 168 time: 0.2916851 Sep 01 17:00:25.411516 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-936ba687-4c2f-46d5-bdf1-9b896b4f23c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61327d2f-59df-4636-979f-597e35dc5010,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:25.536187 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3bbad0c1-7492-4fe8-8dc4-6ef385fbe8e0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:25.663720 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3bbad0c1-7492-4fe8-8dc4-6ef385fbe8e0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:25.669033 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3bbad0c1-7492-4fe8-8dc4-6ef385fbe8e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:25.731699 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bbad0c1-7492-4fe8-8dc4-6ef385fbe8e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2bee0dc-1722-463a-9379-42fd30dc85e0,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:25.754407 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-3bbad0c1-7492-4fe8-8dc4-6ef385fbe8e0 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=d4b0db9ceaf848468645ace6692f7654&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5361369 Sep 01 17:00:25.754928 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 54886) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:25.847682 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-b36e69b1-e0c2-461a-a78c-efff8bdbb547 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:25.876360 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-b36e69b1-e0c2-461a-a78c-efff8bdbb547 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:25.889034 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6494adf-c93d-47f7-8d34-e08ddffaa217 req-e8f24c59-4b20-451c-9c7f-980eea25238d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:25.891532 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a6494adf-c93d-47f7-8d34-e08ddffaa217 req-e8f24c59-4b20-451c-9c7f-980eea25238d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.1112964 Sep 01 17:00:25.942794 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-b36e69b1-e0c2-461a-a78c-efff8bdbb547 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:25.945853 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-b36e69b1-e0c2-461a-a78c-efff8bdbb547 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:25.951100 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-b36e69b1-e0c2-461a-a78c-efff8bdbb547 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/d2bee0dc-1722-463a-9379-42fd30dc85e0 HTTP/1.1" status: 204 len: 168 time: 0.1952448 Sep 01 17:00:25.968539 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a6494adf-c93d-47f7-8d34-e08ddffaa217 req-7fd07d9e-62c3-4fe4-b72b-caba3e58a184 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701864 Sep 01 17:00:25.971116 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b36e69b1-e0c2-461a-a78c-efff8bdbb547 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2bee0dc-1722-463a-9379-42fd30dc85e0,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:26.435167 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:26.492248 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05568c61-d6f7-4728-bb65-a30aa9819615 req-71e1c36f-0092-40d9-8e3b-89f855af3b0f tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:26.494693 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-05568c61-d6f7-4728-bb65-a30aa9819615 req-71e1c36f-0092-40d9-8e3b-89f855af3b0f tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0553794 Sep 01 17:00:26.539159 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:26.546823 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-05568c61-d6f7-4728-bb65-a30aa9819615 req-f9fda140-e9d3-4d92-b510-0527c8393861 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438125 Sep 01 17:00:27.096839 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b83c43a-3878-4710-9fe9-f3a42beb2d5c req-566565b4-937b-47c8-b1cf-421c243a4dbb tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:27.098335 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5b83c43a-3878-4710-9fe9-f3a42beb2d5c req-566565b4-937b-47c8-b1cf-421c243a4dbb tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0474710 Sep 01 17:00:27.136238 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5b83c43a-3878-4710-9fe9-f3a42beb2d5c req-1747eb2d-1aad-4128-9049-73b7e361433e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319312 Sep 01 17:00:27.661940 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f962272e-ce95-4301-92a1-eb908151925e req-31c344e9-8271-454b-aa02-2d4b7d5da710 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:27.663395 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f962272e-ce95-4301-92a1-eb908151925e req-31c344e9-8271-454b-aa02-2d4b7d5da710 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0507426 Sep 01 17:00:27.700197 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f962272e-ce95-4301-92a1-eb908151925e req-a9bd5e16-87a6-45e5-98f3-a65933e190cb tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304704 Sep 01 17:00:28.249440 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b984fe8b-45b1-4516-8a45-97cf849e5fd3 req-90dc34b5-3b79-4c18-9b7a-cbf8ac81f95c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:28.250925 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b984fe8b-45b1-4516-8a45-97cf849e5fd3 req-90dc34b5-3b79-4c18-9b7a-cbf8ac81f95c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0486603 Sep 01 17:00:28.290576 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b984fe8b-45b1-4516-8a45-97cf849e5fd3 req-d43224be-8989-4212-b25b-5cc11af9bbbf tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338178 Sep 01 17:00:28.409549 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Request body: {'port': {'device_id': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:28.465911 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:28.701529 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be7deb6-ce46-444f-8d69-6dab27632dea req-96abbed1-c887-464e-88b4-43b6d4ecf289 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:28.707230 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4be7deb6-ce46-444f-8d69-6dab27632dea req-96abbed1-c887-464e-88b4-43b6d4ecf289 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=4199ca0b18374af7856c19238fc2fea1&device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 1098 time: 0.1039987 Sep 01 17:00:28.851583 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a3c0c47-17ae-4874-9629-0c4969422571 req-1f9ec6db-d849-4eea-a567-3c4e8df54c1e tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:28.854008 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4a3c0c47-17ae-4874-9629-0c4969422571 req-1f9ec6db-d849-4eea-a567-3c4e8df54c1e tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 931 time: 0.0823674 Sep 01 17:00:28.875517 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6f9364de-2626-4bc4-828f-69a19d15adc9 {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:00:28.879685 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:28.896348 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Transition to ACTIVE for port object 6f9364de-2626-4bc4-828f-69a19d15adc9 will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:28.905429 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be7deb6-ce46-444f-8d69-6dab27632dea req-0def77f3-933c-448c-bd1c-cbd4b33b465f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:28.906620 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4be7deb6-ce46-444f-8d69-6dab27632dea req-0def77f3-933c-448c-bd1c-cbd4b33b465f service neutron] 10.222.0.69 "GET /v2.0/networks?id=63606bb0-66bd-46d6-ba6c-55c6da830865 HTTP/1.1" status: 200 len: 920 time: 0.1715450 Sep 01 17:00:28.907645 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:28.914996 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4a3c0c47-17ae-4874-9629-0c4969422571 req-47a76333-1588-433b-846d-f04437c8385c tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538356 Sep 01 17:00:29.000162 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4be7deb6-ce46-444f-8d69-6dab27632dea req-e52ff650-f6a0-4e54-862e-9d1c16053ea4 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e3d13334-c7d0-4f40-a25b-5c27c5f90c65 HTTP/1.1" status: 200 len: 217 time: 0.0529714 Sep 01 17:00:29.033645 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Pushing event updated for resources: {'Port': ['ID=6f9364de-2626-4bc4-828f-69a19d15adc9,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:29.129873 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be7deb6-ce46-444f-8d69-6dab27632dea req-f2c988af-bd3b-4b3d-81a8-d5f36d71b89d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:29.131364 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4be7deb6-ce46-444f-8d69-6dab27632dea req-f2c988af-bd3b-4b3d-81a8-d5f36d71b89d service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd331d5b-40b1-4163-8537-7af4e56f1efd HTTP/1.1" status: 200 len: 859 time: 0.1053221 Sep 01 17:00:29.155842 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Attempting to bind port 6f9364de-2626-4bc4-828f-69a19d15adc9 on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:00:29.156177 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Attempting to bind port 6f9364de-2626-4bc4-828f-69a19d15adc9 by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': 'bd15a57e-34c6-42ac-abbb-bea94ad6f705', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:00:29.156707 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Attempting to bind port 6f9364de-2626-4bc4-828f-69a19d15adc9 on network ab951243-4254-4532-9d93-c294f4a98543 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:00:29.174439 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-28310870-6d49-4465-a986-8655ad83810f tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/networks?tenant_id=d2a03b2bcd68480a8a5796825671a2f1&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0376194 Sep 01 17:00:29.175083 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4be7deb6-ce46-444f-8d69-6dab27632dea req-c45de465-f965-48cf-86fc-f61b9c113068 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=63606bb0-66bd-46d6-ba6c-55c6da830865&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0302093 Sep 01 17:00:29.176105 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Port 6f9364de-2626-4bc4-828f-69a19d15adc9 on network ab951243-4254-4532-9d93-c294f4a98543 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:00:29.176426 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Attempting to bind port 6f9364de-2626-4bc4-828f-69a19d15adc9 on network ab951243-4254-4532-9d93-c294f4a98543 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:00:29.182315 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 0, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:00:29.182838 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Checking segment: {'id': 'bd15a57e-34c6-42ac-abbb-bea94ad6f705', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:00:29.183168 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Bound using segment: {'id': 'bd15a57e-34c6-42ac-abbb-bea94ad6f705', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:00:29.183605 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Bound port: 6f9364de-2626-4bc4-828f-69a19d15adc9, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bd15a57e-34c6-42ac-abbb-bea94ad6f705', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 508, 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:00:29.183959 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:29.319192 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] For port 6f9364de-2626-4bc4-828f-69a19d15adc9, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:00:29.323566 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4be7deb6-ce46-444f-8d69-6dab27632dea req-d4a04968-1f2f-415f-ab5b-8faaf898b523 service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1365836 Sep 01 17:00:29.325296 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] For port 6f9364de-2626-4bc4-828f-69a19d15adc9, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=6f9364de-2626-4bc4-828f-69a19d15adc9,segment=NetworkSegment(bd15a57e-34c6-42ac-abbb-bea94ad6f705),segment_id=bd15a57e-34c6-42ac-abbb-bea94ad6f705)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:00:29.330139 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:29.398388 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-c31f878a-1b1b-487b-bfc0-3ab9ab59637c tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:29.400138 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-c31f878a-1b1b-487b-bfc0-3ab9ab59637c tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2091179 Sep 01 17:00:29.431353 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:29.431980 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:29.433412 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f4ded56d-283e-4bb6-9734-da684663f988 req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] 10.222.0.69 "PUT /v2.0/ports/6f9364de-2626-4bc4-828f-69a19d15adc9 HTTP/1.1" status: 200 len: 1093 time: 1.0285764 Sep 01 17:00:29.434764 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-e12d40e8-ed77-439b-bb5b-7773438fa99e tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/quotas/d2a03b2bcd68480a8a5796825671a2f1 HTTP/1.1" status: 200 len: 375 time: 0.0155618 Sep 01 17:00:29.436468 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'tag': '6f9364de-2626-4bc4-828f-69a19d15adc9'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:00:29.439360 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-951e9f57-37a5-420f-9dbe-891c9a5932b8" -d '{"events": [{"name": "network-changed", "server_uuid": "f84d355d-ae15-4f65-860a-2ccf43911f7e", "tag": "6f9364de-2626-4bc4-828f-69a19d15adc9"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:00:29.461119 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f02363-1419-491c-a39b-bc919dd4d0b8 req-d6b1cbf8-993b-49de-bc57-89f882bed243 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:29.462812 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-52f02363-1419-491c-a39b-bc919dd4d0b8 req-d6b1cbf8-993b-49de-bc57-89f882bed243 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0893021 Sep 01 17:00:29.492832 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-15ef75bf-1456-4b84-a80f-c2cddc8da9cd tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=d2a03b2bcd68480a8a5796825671a2f1&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0283883 Sep 01 17:00:29.505806 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4be7deb6-ce46-444f-8d69-6dab27632dea req-a50ae022-7656-481b-91c2-94023438b435 service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1719847 Sep 01 17:00:29.549968 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-52f02363-1419-491c-a39b-bc919dd4d0b8 req-a6fc94ad-ebd2-4448-9ad7-0d3b3bacd3dc tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0742483 Sep 01 17:00:29.589053 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fd42198-8be2-4c4c-877e-2d86808cc11f service neutron] Pushing event updated for resources: {'Port': ['ID=6f9364de-2626-4bc4-828f-69a19d15adc9,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:29.625884 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ded56d-283e-4bb6-9734-da684663f988 req-0816fbaf-de67-4bf4-a853-45d3bb1eeadb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:29.628101 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f4ded56d-283e-4bb6-9734-da684663f988 req-0816fbaf-de67-4bf4-a853-45d3bb1eeadb service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=ccf739a17862469f9bbcedc5abe17cd1&device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 1096 time: 0.1016903 Sep 01 17:00:29.699427 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f4ded56d-283e-4bb6-9734-da684663f988 req-5611d9c4-e509-4998-98f2-cc71b210a82f service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6f9364de-2626-4bc4-828f-69a19d15adc9 HTTP/1.1" status: 200 len: 217 time: 0.0540717 Sep 01 17:00:29.750006 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:00:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08796251-0c98-4e39-b343-7ed99dc13017 x-openstack-request-id: req-08796251-0c98-4e39-b343-7ed99dc13017 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:00:29.753759 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f84d355d-ae15-4f65-860a-2ccf43911f7e", "tag": "6f9364de-2626-4bc4-828f-69a19d15adc9", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:00:29.754208 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-08796251-0c98-4e39-b343-7ed99dc13017 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:00:29.754802 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'tag': '6f9364de-2626-4bc4-828f-69a19d15adc9', 'status': 'completed', 'code': 200} Sep 01 17:00:29.802842 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-43f73981-9668-4b26-ba3b-44995805a2a1 req-6c984a28-9be6-4f0d-947d-41a48e115455 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 210 time: 0.0298262 Sep 01 17:00:29.843456 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ded56d-283e-4bb6-9734-da684663f988 req-3a4a1f84-b59e-4784-a437-27d6b5fe0325 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:29.844620 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f4ded56d-283e-4bb6-9734-da684663f988 req-3a4a1f84-b59e-4784-a437-27d6b5fe0325 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=eda7763d-791a-46fa-8a76-190c2898271d HTTP/1.1" status: 200 len: 853 time: 0.1350009 Sep 01 17:00:29.999313 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ded56d-283e-4bb6-9734-da684663f988 req-e5d6a15b-6ca3-401b-a5f6-e54f72174bc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:30.000883 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f4ded56d-283e-4bb6-9734-da684663f988 req-e5d6a15b-6ca3-401b-a5f6-e54f72174bc3 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=ab951243-4254-4532-9d93-c294f4a98543&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1443255 Sep 01 17:00:30.130527 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01e699ae-827c-4beb-beef-9ee025713fdf req-69cc2f18-4e37-4753-9209-f6412c874cba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:30.132475 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-01e699ae-827c-4beb-beef-9ee025713fdf req-69cc2f18-4e37-4753-9209-f6412c874cba service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 1098 time: 0.0661016 Sep 01 17:00:30.165910 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f4ded56d-283e-4bb6-9734-da684663f988 req-4ca4514f-9fbf-4c3b-be73-b54fa301a9ff service neutron] 10.222.0.69 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1544662 Sep 01 17:00:30.199288 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-01e699ae-827c-4beb-beef-9ee025713fdf req-30dd49bc-3d76-4978-8a74-8b9d09d892d1 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0577209 Sep 01 17:00:30.228313 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40138d79-a277-43fb-ae4a-c9e491c08c86 req-7c705ff4-7df1-4fd0-8d17-1a7f41ff7d81 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:30.238287 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-40138d79-a277-43fb-ae4a-c9e491c08c86 req-7c705ff4-7df1-4fd0-8d17-1a7f41ff7d81 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 943 time: 0.1863000 Sep 01 17:00:30.277593 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f4ded56d-283e-4bb6-9734-da684663f988 req-c78e1354-a632-4f19-a104-cec19ee84a22 service neutron] 10.222.0.69 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1019385 Sep 01 17:00:30.285317 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-7156e48c-d086-4ae5-9aca-626fe02d5037 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:30.290666 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-7156e48c-d086-4ae5-9aca-626fe02d5037 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/networks?id=8331b65a-166e-454c-a3c5-ed861dc82dfc HTTP/1.1" status: 200 len: 814 time: 0.2403369 Sep 01 17:00:30.327839 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-40138d79-a277-43fb-ae4a-c9e491c08c86 req-7697a5ec-ea02-4140-b8d3-ed20b0fb5cfd tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0885484 Sep 01 17:00:30.329496 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-03ef2326-74a0-40c5-b9e0-b9165511c57b tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/quotas/7032b30e75954f8da9ad2cb64f1f5ad1 HTTP/1.1" status: 200 len: 375 time: 0.0311189 Sep 01 17:00:30.385939 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-d5fbb1f5-1252-452c-8d68-e3d2df656337 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=7032b30e75954f8da9ad2cb64f1f5ad1&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0500646 Sep 01 17:00:30.487323 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-744437c8-ce32-4d2d-8156-cbdaf407656e service neutron] 10.222.0.67 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0945506 Sep 01 17:00:30.534968 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951e9f57-37a5-420f-9dbe-891c9a5932b8 req-cf62be95-208e-4908-b4f7-bce4153eb19f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:30.537257 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-951e9f57-37a5-420f-9dbe-891c9a5932b8 req-cf62be95-208e-4908-b4f7-bce4153eb19f service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=ccf739a17862469f9bbcedc5abe17cd1&device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 1096 time: 0.0524209 Sep 01 17:00:30.596580 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-eac143cf-af1a-4e03-a7ab-47d1833ffa44 service neutron] 10.222.0.67 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0994229 Sep 01 17:00:30.647521 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951e9f57-37a5-420f-9dbe-891c9a5932b8 req-2795220f-1e32-4b20-b095-9a813c059e57 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:30.649475 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-951e9f57-37a5-420f-9dbe-891c9a5932b8 req-2795220f-1e32-4b20-b095-9a813c059e57 service neutron] 10.222.0.69 "GET /v2.0/networks?id=ab951243-4254-4532-9d93-c294f4a98543 HTTP/1.1" status: 200 len: 915 time: 0.0929537 Sep 01 17:00:30.690922 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6caabc7-ca0a-45c3-86cd-813abb03fad0 req-cee2ee08-d7db-4116-be40-6d7cb576ffff tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:30.692422 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e6caabc7-ca0a-45c3-86cd-813abb03fad0 req-cee2ee08-d7db-4116-be40-6d7cb576ffff tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0517023 Sep 01 17:00:30.745895 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e6caabc7-ca0a-45c3-86cd-813abb03fad0 req-08546b4a-7e88-4b4b-a7e0-6b8c1e6021f7 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427065 Sep 01 17:00:30.778764 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0dd82235-50dc-4359-bb75-d7cc72d3207d req-1757bc7e-4893-4f75-96f5-4247fc8252e7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 210 time: 0.0308239 Sep 01 17:00:30.907756 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-78ccb27c-98a7-4e6e-9530-1e2bef1b1d64 req-1bbd8514-e71a-4e08-b505-d4270abdafc9 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 210 time: 0.0264454 Sep 01 17:00:31.446962 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43c134d5-4bb6-4064-b4eb-9b9d08795d12 req-92b0d978-41b6-4f06-a1bb-b7e9766a0b13 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:31.448407 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-43c134d5-4bb6-4064-b4eb-9b9d08795d12 req-92b0d978-41b6-4f06-a1bb-b7e9766a0b13 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 943 time: 0.0486844 Sep 01 17:00:31.485233 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-43c134d5-4bb6-4064-b4eb-9b9d08795d12 req-66e34e62-b617-4b71-895c-fbc006cd62ad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309608 Sep 01 17:00:31.875671 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-dba73d85-5ec6-4f93-80ea-3bc8a22045a7 req-f7dfe180-aea0-4ba6-ad4e-f33255c0c070 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 210 time: 0.0317101 Sep 01 17:00:31.888051 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f1e7dc-62b6-4ce4-87fb-f1d86d81d3f5 req-ab2ed309-d1fe-49de-b498-d44e5676db12 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:31.889551 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-30f1e7dc-62b6-4ce4-87fb-f1d86d81d3f5 req-ab2ed309-d1fe-49de-b498-d44e5676db12 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0739925 Sep 01 17:00:31.927585 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-30f1e7dc-62b6-4ce4-87fb-f1d86d81d3f5 req-7684019a-f8f3-4bda-8ac1-fbd7cbd55470 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322986 Sep 01 17:00:32.000135 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5a4e998f-0dd9-4ca0-b912-3a26a7bc14ea req-88cdeb73-c00d-40dc-acfb-d6d313dcad23 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 210 time: 0.0253403 Sep 01 17:00:32.582687 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-951e9f57-37a5-420f-9dbe-891c9a5932b8 req-0b5e9572-71d8-4997-a2e4-36c7d56fba79 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6f9364de-2626-4bc4-828f-69a19d15adc9 HTTP/1.1" status: 200 len: 217 time: 0.0365126 Sep 01 17:00:32.597894 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b99d71-2f5f-47f7-bb1c-1b722a10f672 req-294bd96a-24d0-497a-a6f0-c22e9ccb7daa tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:32.599374 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-63b99d71-2f5f-47f7-bb1c-1b722a10f672 req-294bd96a-24d0-497a-a6f0-c22e9ccb7daa tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 943 time: 0.0494571 Sep 01 17:00:32.636627 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-63b99d71-2f5f-47f7-bb1c-1b722a10f672 req-df2a2e01-fde9-4c4b-855d-fd77cb5b7bcd tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302904 Sep 01 17:00:32.967741 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0728f6fb-2136-489f-8d3c-b48f65c014a1 req-1d299299-2750-411d-a535-86de9ac966c0 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 210 time: 0.0292263 Sep 01 17:00:33.041562 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b522597a-6896-42e1-a768-7bee414ad3f5 req-8d3a25fb-dcee-4113-a0a1-b8a026b16e95 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:33.041829 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b522597a-6896-42e1-a768-7bee414ad3f5 req-8d3a25fb-dcee-4113-a0a1-b8a026b16e95 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0486367 Sep 01 17:00:33.088790 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b522597a-6896-42e1-a768-7bee414ad3f5 req-193078f8-3eb5-4ea2-a258-b90231e412bf tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411899 Sep 01 17:00:33.102841 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e58bc7b2-712a-4941-bcc9-c1aa0eba8055 req-9ffbf213-0852-469d-89e5-a717bd4e021e tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 210 time: 0.0302463 Sep 01 17:00:33.640983 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951e9f57-37a5-420f-9dbe-891c9a5932b8 req-b3661934-4cf3-43bb-a322-d8d6f6bf600d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:33.642488 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-951e9f57-37a5-420f-9dbe-891c9a5932b8 req-b3661934-4cf3-43bb-a322-d8d6f6bf600d service neutron] 10.222.0.69 "GET /v2.0/subnets?id=eda7763d-791a-46fa-8a76-190c2898271d HTTP/1.1" status: 200 len: 853 time: 0.0463889 Sep 01 17:00:33.707868 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951e9f57-37a5-420f-9dbe-891c9a5932b8 req-3567ba29-ac1d-4e7a-9e42-0c16f8ce3caa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:33.709379 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-951e9f57-37a5-420f-9dbe-891c9a5932b8 req-3567ba29-ac1d-4e7a-9e42-0c16f8ce3caa service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=ab951243-4254-4532-9d93-c294f4a98543&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0461044 Sep 01 17:00:33.753229 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4d4206-9720-4b8e-a0b1-1dc616205bfd req-c02f5134-09ef-4184-a425-110cc3ff031a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:33.754749 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ff4d4206-9720-4b8e-a0b1-1dc616205bfd req-c02f5134-09ef-4184-a425-110cc3ff031a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 943 time: 0.0494764 Sep 01 17:00:33.794013 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ff4d4206-9720-4b8e-a0b1-1dc616205bfd req-20669968-2bc6-480d-a3ad-bfc31d4df5f4 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329378 Sep 01 17:00:33.813911 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-951e9f57-37a5-420f-9dbe-891c9a5932b8 req-18a642f6-5c3e-40dc-a56e-f3fdd0be92f1 service neutron] 10.222.0.69 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0918570 Sep 01 17:00:33.907106 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-951e9f57-37a5-420f-9dbe-891c9a5932b8 req-a6b189f5-5ff3-4689-affe-7f9065078ef8 service neutron] 10.222.0.69 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831990 Sep 01 17:00:34.067735 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1edaccd7-4d14-4370-b18e-ca1ff2d53306 req-a80363be-79bf-4799-b796-dac330b572f2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 210 time: 0.0329888 Sep 01 17:00:34.206818 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c20c18da-c73c-441d-8a55-d3e1031583d0 req-164f20d1-81af-443e-9632-87d72bc604c4 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:34.208813 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c20c18da-c73c-441d-8a55-d3e1031583d0 req-164f20d1-81af-443e-9632-87d72bc604c4 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0524185 Sep 01 17:00:34.250219 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c20c18da-c73c-441d-8a55-d3e1031583d0 req-6eea3e22-7972-4768-8e5c-04d7efd53a8a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355031 Sep 01 17:00:34.388196 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5b59d53c-9b2f-4505-b2b0-95d1c0d11e5b req-14164fdf-294a-41c0-99b8-3a2697b37d7a tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 210 time: 0.0441291 Sep 01 17:00:34.410710 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32dedcb4-b629-417e-8009-77001b5c99b0 req-283a5f36-294e-4d47-a1ed-48497d99ffdb tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:34.412338 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-32dedcb4-b629-417e-8009-77001b5c99b0 req-283a5f36-294e-4d47-a1ed-48497d99ffdb tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0769475 Sep 01 17:00:34.480943 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-32dedcb4-b629-417e-8009-77001b5c99b0 req-c29b9ed7-044a-4d00-89a3-e9d06b17281d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0604577 Sep 01 17:00:34.514988 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-e86c9629-6910-4ac4-b320-f9bf5ff59c4d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.69 "GET /v2.0/networks?tenant_id=d2a03b2bcd68480a8a5796825671a2f1&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0508018 Sep 01 17:00:34.729342 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4bdbd34d-9c15-4a44-b116-f857e56ae0b4 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:34.730996 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4bdbd34d-9c15-4a44-b116-f857e56ae0b4 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.69 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2087328 Sep 01 17:00:34.747468 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Request body: {'port': {'device_id': '05e4c24b-2664-4883-bc91-fbef674b70b4', 'network_id': 'e9938d8d-ca3e-435d-b9ce-6643cd80643e', 'admin_state_up': True, 'tenant_id': 'd2a03b2bcd68480a8a5796825671a2f1'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:34.928243 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e9f99b8-fdf5-4e77-af2e-71fe1243ab41 req-82156502-5688-4082-aa8d-9395d743df51 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:34.931268 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5e9f99b8-fdf5-4e77-af2e-71fe1243ab41 req-82156502-5688-4082-aa8d-9395d743df51 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 943 time: 0.0639269 Sep 01 17:00:34.970890 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5e9f99b8-fdf5-4e77-af2e-71fe1243ab41 req-3e5d8225-d1df-4808-a83c-a9abeff88a95 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338705 Sep 01 17:00:35.043350 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Made reservation on behalf of d2a03b2bcd68480a8a5796825671a2f1 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:00:35.046834 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:35.056309 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:35.148415 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:35.152515 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:35.181627 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f41694c7-5ec5-46a1-83ff-82d9768831c3 req-dee69d24-746d-44b4-864d-c16ccdbb0526 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 210 time: 0.0265958 Sep 01 17:00:35.220152 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:35.295200 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Allocated IP 192.168.233.187 (e9938d8d-ca3e-435d-b9ce-6643cd80643e/1e312bda-993b-4495-b01a-9110a964ebd6/1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:00:35.376460 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d02fb6a-dd6a-41b9-9f1a-93422ad7e213 req-750bf39d-b46b-42eb-aee9-8e1116382ed5 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:35.377980 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5d02fb6a-dd6a-41b9-9f1a-93422ad7e213 req-750bf39d-b46b-42eb-aee9-8e1116382ed5 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0497389 Sep 01 17:00:35.427389 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5d02fb6a-dd6a-41b9-9f1a-93422ad7e213 req-4ecd44d5-c41e-4237-b975-10386e3b2d06 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425000 Sep 01 17:00:35.466690 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:35.486650 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Transition to ACTIVE for port object 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:35.500468 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-731b434d-2798-4aef-a563-101939a965ba req-7b6bbc94-9415-4662-8408-ee60990f70f7 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 210 time: 0.0313077 Sep 01 17:00:35.535316 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:35.602783 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Network e9938d8d-ca3e-435d-b9ce-6643cd80643e is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:00:35.606314 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:00:35.610768 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:00:35.614731 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Pushing event updated for resources: {'Port': ['ID=1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:35.633282 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26837418-b8e4-47b4-8cf7-33e2a7c05b65 req-7f30c531-acb6-46de-99dd-a4b6873e6e05 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:35.635032 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-26837418-b8e4-47b4-8cf7-33e2a7c05b65 req-7f30c531-acb6-46de-99dd-a4b6873e6e05 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0592663 Sep 01 17:00:35.672228 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:35.672871 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:35.692250 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-4b740ee2-1f17-4b11-b963-8f56faf7c47d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.9480486 Sep 01 17:00:35.693908 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-26837418-b8e4-47b4-8cf7-33e2a7c05b65 req-14b4dd14-c1d1-4cb8-b970-c6b76c71ffa3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0527849 Sep 01 17:00:35.759407 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ce32857-99e5-42b7-9338-2358c3d0574a req-70dcb610-53df-49b0-aa52-2b7f96dd9e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:35.760981 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2ce32857-99e5-42b7-9338-2358c3d0574a req-70dcb610-53df-49b0-aa52-2b7f96dd9e52 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0544417 Sep 01 17:00:35.800840 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2ce32857-99e5-42b7-9338-2358c3d0574a req-ada24691-913e-443d-96dc-22864738f929 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0337114 Sep 01 17:00:35.882313 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-2bbc6d63-236c-41bf-a62e-7c80c6d38850 None None] Provisioning for port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:35.886092 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-2bbc6d63-236c-41bf-a62e-7c80c6d38850 None None] Provisioning complete for port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:35.886464 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-2bbc6d63-236c-41bf-a62e-7c80c6d38850 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:35.919131 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-2bbc6d63-236c-41bf-a62e-7c80c6d38850 None None] Port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:00:36.086167 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b925786-c62f-4f74-8914-65e97bdaf652 req-6aff8e90-ac79-4c1f-ac68-dc73bea7dc27 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:36.087816 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0b925786-c62f-4f74-8914-65e97bdaf652 req-6aff8e90-ac79-4c1f-ac68-dc73bea7dc27 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 943 time: 0.0512214 Sep 01 17:00:36.124084 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0b925786-c62f-4f74-8914-65e97bdaf652 req-f838c4d3-8d14-4de2-a166-af75b5922c62 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304132 Sep 01 17:00:36.274778 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-badd0378-6dd5-4e16-bb61-e8e909f60a60 req-8ed66da6-639e-4274-b23b-2b911e8a4403 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 210 time: 0.0262361 Sep 01 17:00:36.625451 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60bf131b-87ef-4a3b-b941-a56e5de8c242 req-74d03d11-195b-457b-8ad3-bf5d76ce8742 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:36.626973 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-60bf131b-87ef-4a3b-b941-a56e5de8c242 req-74d03d11-195b-457b-8ad3-bf5d76ce8742 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 936 time: 0.0529795 Sep 01 17:00:36.665222 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-60bf131b-87ef-4a3b-b941-a56e5de8c242 req-fbafaae2-43e8-443b-a036-de4d43be86b7 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316668 Sep 01 17:00:36.816323 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4bb9aa9-aa89-436d-802c-80eac404d851 req-e67811ad-2930-4bc2-8c44-1c64f2b7ad6d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:36.817753 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a4bb9aa9-aa89-436d-802c-80eac404d851 req-e67811ad-2930-4bc2-8c44-1c64f2b7ad6d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0522645 Sep 01 17:00:36.856806 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a4bb9aa9-aa89-436d-802c-80eac404d851 req-2ea4b936-db04-4f12-a621-29b63e636e0e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325956 Sep 01 17:00:36.915993 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2246ea4f-8ef0-42a1-bcd5-4c64807e2ef7 req-70ba72c7-5e3a-4f37-962d-632f57cdc5ec tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:36.917495 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2246ea4f-8ef0-42a1-bcd5-4c64807e2ef7 req-70ba72c7-5e3a-4f37-962d-632f57cdc5ec tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0491283 Sep 01 17:00:36.956404 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2246ea4f-8ef0-42a1-bcd5-4c64807e2ef7 req-3e56e967-b902-4999-b6f7-830ad3a245cc tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329816 Sep 01 17:00:37.235429 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-202189cc-75fe-45e9-9b7d-3d83842407ad req-7db0cc54-e494-4239-8b78-06651e310849 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:37.236876 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-202189cc-75fe-45e9-9b7d-3d83842407ad req-7db0cc54-e494-4239-8b78-06651e310849 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 943 time: 0.0473838 Sep 01 17:00:37.272872 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-202189cc-75fe-45e9-9b7d-3d83842407ad req-aca389b9-8934-44b0-b942-964eee22bb78 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0294874 Sep 01 17:00:37.375936 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-501fb8ac-1bcb-442b-bac8-32445f9f7757 req-f8a096c3-dc94-4d19-be55-6230878e37ec tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 210 time: 0.0363481 Sep 01 17:00:37.778067 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c195fa08-2581-499b-b57c-56e6d4fad529 req-bf4ceb18-1d95-49d8-a615-3ffc71039e37 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:37.779532 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c195fa08-2581-499b-b57c-56e6d4fad529 req-bf4ceb18-1d95-49d8-a615-3ffc71039e37 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 936 time: 0.0488079 Sep 01 17:00:37.816205 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c195fa08-2581-499b-b57c-56e6d4fad529 req-b77d293b-2a98-4a78-a3f6-924e4ffb7edd tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308411 Sep 01 17:00:37.986184 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc3756c4-c764-4bea-8003-8a1516e622e8 req-89e78d85-9863-47fa-b107-a6b49f3b5c40 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:37.988872 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fc3756c4-c764-4bea-8003-8a1516e622e8 req-89e78d85-9863-47fa-b107-a6b49f3b5c40 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0484719 Sep 01 17:00:37.991576 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 6f9364de-2626-4bc4-828f-69a19d15adc9 details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:00:38.016133 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Request body: {'port': {'device_id': '05e4c24b-2664-4883-bc91-fbef674b70b4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:38.041457 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fc3756c4-c764-4bea-8003-8a1516e622e8 req-06dad948-766b-47ed-88a8-ca0393bc6a81 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404198 Sep 01 17:00:38.121604 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 6f9364de-2626-4bc4-828f-69a19d15adc9, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=6f9364de-2626-4bc4-828f-69a19d15adc9,segment=NetworkSegment(bd15a57e-34c6-42ac-abbb-bea94ad6f705),segment_id=bd15a57e-34c6-42ac-abbb-bea94ad6f705)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:38.134912 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': '6f9364de-2626-4bc4-828f-69a19d15adc9', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'port_id': '6f9364de-2626-4bc4-828f-69a19d15adc9', 'mac_address': 'fa:16:3e:84:dd:12', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 508, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:00:38.137640 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd69498e-5cf4-4df9-b057-b118f8b0453a req-fce11ddd-fcb8-4eec-99cc-21b54de6942c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:38.139826 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cd69498e-5cf4-4df9-b057-b118f8b0453a req-fce11ddd-fcb8-4eec-99cc-21b54de6942c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0669918 Sep 01 17:00:38.183583 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:38.187810 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:38.196770 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cd69498e-5cf4-4df9-b057-b118f8b0453a req-60dc484f-9d66-4cfd-b629-a945f0152964 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507340 Sep 01 17:00:38.203753 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6f9364de-2626-4bc4-828f-69a19d15adc9 {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:00:38.229168 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 6f9364de-2626-4bc4-828f-69a19d15adc9, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=6f9364de-2626-4bc4-828f-69a19d15adc9,segment=NetworkSegment(bd15a57e-34c6-42ac-abbb-bea94ad6f705),segment_id=bd15a57e-34c6-42ac-abbb-bea94ad6f705)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:38.233074 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:38.246897 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d3dbe8-0d9d-4374-a060-c25bfaca274d req-cfab9468-b890-4c3a-80f9-bb379d41d97e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:38.248415 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a8d3dbe8-0d9d-4374-a060-c25bfaca274d req-cfab9468-b890-4c3a-80f9-bb379d41d97e service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=4199ca0b18374af7856c19238fc2fea1&device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 1098 time: 0.1643474 Sep 01 17:00:38.285583 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=6f9364de-2626-4bc4-828f-69a19d15adc9,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:38.292529 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:38.292898 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:38.293242 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:38.293601 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:38.293958 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:38.294299 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:38.294622 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:38.295016 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:38.295326 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:38.295675 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:38.295999 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:38.296317 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:38.360275 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-a635a0f4-f6c6-48f3-9626-3c7a4c214f06 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:38.361765 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-a635a0f4-f6c6-48f3-9626-3c7a4c214f06 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "GET /v2.0/networks?id=8331b65a-166e-454c-a3c5-ed861dc82dfc HTTP/1.1" status: 200 len: 814 time: 0.3427122 Sep 01 17:00:38.378605 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-bfe20350-09b7-4ccb-8178-6f751fc637d2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Request body: {'port': {'device_id': '0239f1a0-a747-468c-b1c3-baae21f2e1ae', 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc', 'admin_state_up': True, 'tenant_id': '7032b30e75954f8da9ad2cb64f1f5ad1'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:38.393511 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b46bce1-750a-4ac9-9380-35aece2dd7f5 req-8298d0a9-3b57-489f-b48a-dc33fa2ef9da tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:38.395058 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2b46bce1-750a-4ac9-9380-35aece2dd7f5 req-8298d0a9-3b57-489f-b48a-dc33fa2ef9da tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 944 time: 0.0513797 Sep 01 17:00:38.439467 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2b46bce1-750a-4ac9-9380-35aece2dd7f5 req-a6523b9f-be0f-4106-9516-1904e4222de1 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376675 Sep 01 17:00:38.478826 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-00736fe7-31e5-462c-86f7-67c5f327e4c5 req-6a7c5601-7832-4869-b1f4-036ccad989ec tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 210 time: 0.0271914 Sep 01 17:00:38.573437 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['6f9364de-2626-4bc4-828f-69a19d15adc9'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:00:38.596880 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d3dbe8-0d9d-4374-a060-c25bfaca274d req-bc76ce64-2717-4633-bf7f-648703da1462 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:38.598443 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a8d3dbe8-0d9d-4374-a060-c25bfaca274d req-bc76ce64-2717-4633-bf7f-648703da1462 service neutron] 10.222.0.69 "GET /v2.0/networks?id=63606bb0-66bd-46d6-ba6c-55c6da830865 HTTP/1.1" status: 200 len: 920 time: 0.3170078 Sep 01 17:00:38.666469 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a8d3dbe8-0d9d-4374-a060-c25bfaca274d req-f65d03cb-4529-4aae-bacf-836d2c83609c service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e3d13334-c7d0-4f40-a25b-5c27c5f90c65 HTTP/1.1" status: 200 len: 217 time: 0.0559578 Sep 01 17:00:38.742191 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-bfe20350-09b7-4ccb-8178-6f751fc637d2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Made reservation on behalf of 7032b30e75954f8da9ad2cb64f1f5ad1 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:00:38.745419 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-bfe20350-09b7-4ccb-8178-6f751fc637d2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:38.819610 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d3dbe8-0d9d-4374-a060-c25bfaca274d req-ab6ad431-da2a-41d4-9aa8-fc858d5bbeb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:38.822009 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a8d3dbe8-0d9d-4374-a060-c25bfaca274d req-ab6ad431-da2a-41d4-9aa8-fc858d5bbeb6 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd331d5b-40b1-4163-8537-7af4e56f1efd HTTP/1.1" status: 200 len: 859 time: 0.1330602 Sep 01 17:00:38.890458 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a8d3dbe8-0d9d-4374-a060-c25bfaca274d req-d7e539f6-f43d-43f9-8be4-8eef497aaafd service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=63606bb0-66bd-46d6-ba6c-55c6da830865&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0555911 Sep 01 17:00:38.942905 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:00:38.959776 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e0314f-ae05-485d-977c-05c95411fcbc req-20e48807-6b03-4de1-9092-65c29af036ce tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:38.961852 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-90e0314f-ae05-485d-977c-05c95411fcbc req-20e48807-6b03-4de1-9092-65c29af036ce tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 936 time: 0.0687056 Sep 01 17:00:38.977341 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.024803 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-90e0314f-ae05-485d-977c-05c95411fcbc req-b70be14d-a3b1-42c7-af61-9ed6639cde7f tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0555327 Sep 01 17:00:39.094713 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Transition to ACTIVE for port object 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:39.104678 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.116599 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-bfe20350-09b7-4ccb-8178-6f751fc637d2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Allocated IP 172.20.0.6 (8331b65a-166e-454c-a3c5-ed861dc82dfc/fd025a14-8839-4451-a03e-bc7daeb612d0/7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:00:39.171532 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a8d3dbe8-0d9d-4374-a060-c25bfaca274d req-645fae02-aca9-47b5-9684-a14dfff0522f service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2451103 Sep 01 17:00:39.173558 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 55214) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:39.194284 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b40c04a-fd3e-4657-9477-0fb5003f57ef req-acc887a9-15d7-409c-a7a9-4d745edd174a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:39.196409 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5b40c04a-fd3e-4657-9477-0fb5003f57ef req-acc887a9-15d7-409c-a7a9-4d745edd174a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0679073 Sep 01 17:00:39.261414 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5b40c04a-fd3e-4657-9477-0fb5003f57ef req-053016e9-1def-4deb-acd0-0cfb8f2ace5b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456705 Sep 01 17:00:39.271895 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Pushing event updated for resources: {'Port': ['ID=1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:39.341789 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2f46c8a0-f751-4a2f-a299-39e4f29bb771 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.365963 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ca680c-7abf-4fde-a82b-75606b85cd6a req-43cc2f15-5522-4553-883b-dcc3c409e1c5 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:39.368099 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-80ca680c-7abf-4fde-a82b-75606b85cd6a req-43cc2f15-5522-4553-883b-dcc3c409e1c5 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0804889 Sep 01 17:00:39.430126 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-80ca680c-7abf-4fde-a82b-75606b85cd6a req-bc810c49-70ac-42a5-87eb-2534ec60ea36 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508122 Sep 01 17:00:39.444212 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a8d3dbe8-0d9d-4374-a060-c25bfaca274d req-14e0fdc2-91ff-4798-89cf-b3df726bd936 service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2541535 Sep 01 17:00:39.467799 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Attempting to bind port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:00:39.468037 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Attempting to bind port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': '158e4a10-7bf0-4070-aeaf-6bca65a0cfb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 533, 'network_id': 'e9938d8d-ca3e-435d-b9ce-6643cd80643e'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:00:39.469725 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Attempting to bind port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 on network e9938d8d-ca3e-435d-b9ce-6643cd80643e {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:00:39.489037 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 on network e9938d8d-ca3e-435d-b9ce-6643cd80643e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:00:39.489371 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Attempting to bind port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 on network e9938d8d-ca3e-435d-b9ce-6643cd80643e {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:00:39.491432 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2f46c8a0-f751-4a2f-a299-39e4f29bb771 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.497157 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2f46c8a0-f751-4a2f-a299-39e4f29bb771 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.505682 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 0, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:00:39.506031 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Checking segment: {'id': '158e4a10-7bf0-4070-aeaf-6bca65a0cfb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 533, 'network_id': 'e9938d8d-ca3e-435d-b9ce-6643cd80643e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:00:39.506425 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Bound using segment: {'id': '158e4a10-7bf0-4070-aeaf-6bca65a0cfb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 533, 'network_id': 'e9938d8d-ca3e-435d-b9ce-6643cd80643e'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:00:39.506873 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Bound port: 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '158e4a10-7bf0-4070-aeaf-6bca65a0cfb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 533, 'network_id': 'e9938d8d-ca3e-435d-b9ce-6643cd80643e'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:00:39.507239 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.561142 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-bfe20350-09b7-4ccb-8178-6f751fc637d2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.566956 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-2f46c8a0-f751-4a2f-a299-39e4f29bb771 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=c6fca103c09b4154a31566f0d23a56e1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3921609 Sep 01 17:00:39.572186 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 55224) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:39.577440 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f46c8a0-f751-4a2f-a299-39e4f29bb771 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7fff3773-c48c-4609-b887-145052ea1ef8,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:39.598653 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cb37c914-6080-4bed-b1fc-02dded8a3117 req-3a4c9361-f4d8-4753-800f-713f4d36ca1e tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 210 time: 0.0362051 Sep 01 17:00:39.620785 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ff8ac9-739c-4f65-9d6c-9e91aea45283 req-32ee7322-ca41-4f17-8b4b-75c93f859ffd tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:39.620785 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-52ff8ac9-739c-4f65-9d6c-9e91aea45283 req-32ee7322-ca41-4f17-8b4b-75c93f859ffd tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 944 time: 0.0967681 Sep 01 17:00:39.651683 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] For port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:00:39.655895 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-52ff8ac9-739c-4f65-9d6c-9e91aea45283 req-6e4a62ae-f104-4931-b239-38273b7d473d tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327926 Sep 01 17:00:39.673849 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] For port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9,segment=NetworkSegment(158e4a10-7bf0-4070-aeaf-6bca65a0cfb8),segment_id=158e4a10-7bf0-4070-aeaf-6bca65a0cfb8)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:00:39.685070 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-bfe20350-09b7-4ccb-8178-6f751fc637d2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.689560 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.722174 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-59d68418-2c9e-41b7-b708-e863642364e6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.734949 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:39.735569 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.736947 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] 10.222.0.69 "PUT /v2.0/ports/1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 HTTP/1.1" status: 200 len: 1098 time: 1.7253103 Sep 01 17:00:39.740954 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '05e4c24b-2664-4883-bc91-fbef674b70b4', 'tag': '1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:00:39.743962 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ae23e9fd-a4f3-4b66-b2c8-6152f3899729" -d '{"events": [{"name": "network-changed", "server_uuid": "05e4c24b-2664-4883-bc91-fbef674b70b4", "tag": "1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:00:39.777276 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfe20350-09b7-4ccb-8178-6f751fc637d2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Pushing event updated for resources: {'Port': ['ID=7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:39.781418 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-bfe20350-09b7-4ccb-8178-6f751fc637d2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Network 8331b65a-166e-454c-a3c5-ed861dc82dfc is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:00:39.787969 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-59d68418-2c9e-41b7-b708-e863642364e6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.792078 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-bfe20350-09b7-4ccb-8178-6f751fc637d2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:00:39.819141 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:00:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f8b16604-e053-4c3a-b8ec-d30db5184931 x-openstack-request-id: req-f8b16604-e053-4c3a-b8ec-d30db5184931 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:00:39.819424 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "05e4c24b-2664-4883-bc91-fbef674b70b4", "tag": "1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:00:39.819671 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-f8b16604-e053-4c3a-b8ec-d30db5184931 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:00:39.820131 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '05e4c24b-2664-4883-bc91-fbef674b70b4', 'tag': '1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9', 'status': 'completed', 'code': 200} Sep 01 17:00:39.820860 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-bfe20350-09b7-4ccb-8178-6f751fc637d2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:00:39.896655 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38e48dae-da35-4824-81f8-d13f4f256b71 service neutron] Pushing event updated for resources: {'Port': ['ID=1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:39.910626 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-bfe20350-09b7-4ccb-8178-6f751fc637d2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:39.911236 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-bfe20350-09b7-4ccb-8178-6f751fc637d2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.927625 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-bfe20350-09b7-4ccb-8178-6f751fc637d2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5538793 Sep 01 17:00:39.928928 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-59d68418-2c9e-41b7-b708-e863642364e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.932035 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-59d68418-2c9e-41b7-b708-e863642364e6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:39.933202 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-59d68418-2c9e-41b7-b708-e863642364e6 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/7fff3773-c48c-4609-b887-145052ea1ef8 HTTP/1.1" status: 204 len: 168 time: 0.3588963 Sep 01 17:00:39.944668 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59d68418-2c9e-41b7-b708-e863642364e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7fff3773-c48c-4609-b887-145052ea1ef8,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:40.135392 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a44fc7b7-6806-41ed-98db-2b8f2da00d8d req-d42355c6-4135-4006-a147-ead986732e21 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:40.137118 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a44fc7b7-6806-41ed-98db-2b8f2da00d8d req-d42355c6-4135-4006-a147-ead986732e21 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 948 time: 0.0488164 Sep 01 17:00:40.178737 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a44fc7b7-6806-41ed-98db-2b8f2da00d8d req-c5bdc4af-4440-4c5d-8709-4879dae0705e tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355420 Sep 01 17:00:40.373668 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42196f81-f29b-4bc2-8ea5-1dfd58b64e67 req-c8510283-cddd-46d7-bfbe-49ce2e5c69fe tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:40.375273 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-42196f81-f29b-4bc2-8ea5-1dfd58b64e67 req-c8510283-cddd-46d7-bfbe-49ce2e5c69fe tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0534461 Sep 01 17:00:40.414182 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-42196f81-f29b-4bc2-8ea5-1dfd58b64e67 req-f61d0c70-5a38-4d2a-8ec2-4c9a3d150aa0 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0329490 Sep 01 17:00:40.548711 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8976f0c1-963f-498c-b6cf-3e1059c5b01f req-23e10b1a-011c-4877-98e9-24ec7ac32c13 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:40.550237 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8976f0c1-963f-498c-b6cf-3e1059c5b01f req-23e10b1a-011c-4877-98e9-24ec7ac32c13 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0494184 Sep 01 17:00:40.565638 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 55256) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:40.589006 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8976f0c1-963f-498c-b6cf-3e1059c5b01f req-892bd89e-b7cb-4bd0-af35-93af0670770a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326643 Sep 01 17:00:40.670786 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-459667960-network', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:40.696879 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] Made reservation on behalf of 63c213b6da7541a0ba2b290c5e15fe03 for: {'network': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:00:40.699432 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:40.709293 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:40.725942 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7958cff-0ee4-4d54-86ef-c2e8e9b3e794 req-c1501537-f728-4ffa-ab01-3bda7324ccdb tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:40.733911 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d7958cff-0ee4-4d54-86ef-c2e8e9b3e794 req-c1501537-f728-4ffa-ab01-3bda7324ccdb tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 931 time: 0.0675688 Sep 01 17:00:40.799741 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d7958cff-0ee4-4d54-86ef-c2e8e9b3e794 req-7239be61-a366-4bc6-8f93-6d50541f8a4c tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0648837 Sep 01 17:00:40.799942 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:40.803830 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:40.811024 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc48795a-62d1-479d-898c-4f1d657bdfcd req-00e59fff-4663-4539-8d37-8062ca83924e tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:40.812464 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bc48795a-62d1-479d-898c-4f1d657bdfcd req-00e59fff-4663-4539-8d37-8062ca83924e tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 944 time: 0.0760992 Sep 01 17:00:40.826689 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] vlan segment allocate from pool success with {'vlan_id': 511, 'physical_network': 'physnet1'} {{(pid=93835) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 17:00:40.841606 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88c60630-7058-4105-a30b-633550b14668,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:40.844449 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:40.844815 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.segments_db [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] Added segment 172bca2a-f8ea-4521-800d-b1528cf503d9 of type vlan for network 35c995f2-96ec-4a35-9f59-05221a09df3f Sep 01 17:00:40.865830 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bc48795a-62d1-479d-898c-4f1d657bdfcd req-3eb6ccbc-2a50-477e-8b5d-b2d74f568c2f tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430231 Sep 01 17:00:40.891885 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:40.916988 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:40.918114 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:40.918707 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:40.974601 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.4078548 Sep 01 17:00:40.978181 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 55264) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:40.984888 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-d92e474c-37d7-4fa0-a8d8-f67eb19448f7 admin admin] Request body: {'subnet': {'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-459667960-subnet', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'ip_version': 4}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:40.994323 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eacb8ea-c5b5-4465-a19b-bb85fe3898a6 admin admin] Pushing event updated for resources: {'Network': ['ID=35c995f2-96ec-4a35-9f59-05221a09df3f,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:41.004313 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network 35c995f2-96ec-4a35-9f59-05221a09df3f details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 17:00:41.009694 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d92e474c-37d7-4fa0-a8d8-f67eb19448f7 admin admin] Made reservation on behalf of 63c213b6da7541a0ba2b290c5e15fe03 for: {'subnet': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:00:41.012009 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d92e474c-37d7-4fa0-a8d8-f67eb19448f7 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5120093'] for subnet, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:41.179252 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d92e474c-37d7-4fa0-a8d8-f67eb19448f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7343016', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5120075'] for subnet, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:41.235302 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d92e474c-37d7-4fa0-a8d8-f67eb19448f7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ab89c120-a892-4afa-a645-bf3caf534f7c,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:41.243399 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d92e474c-37d7-4fa0-a8d8-f67eb19448f7 admin admin] Checking segment: {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:00:41.243765 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d92e474c-37d7-4fa0-a8d8-f67eb19448f7 admin admin] Network hostable DHCP agents. Network: 35c995f2-96ec-4a35-9f59-05221a09df3f, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93835) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 17:00:41.261741 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d92e474c-37d7-4fa0-a8d8-f67eb19448f7 admin admin] Network 35c995f2-96ec-4a35-9f59-05221a09df3f is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93835) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 17:00:41.270381 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-d92e474c-37d7-4fa0-a8d8-f67eb19448f7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, 35c995f2-96ec-4a35-9f59-05221a09df3f) {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:00:41.274621 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d92e474c-37d7-4fa0-a8d8-f67eb19448f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:41.275215 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d92e474c-37d7-4fa0-a8d8-f67eb19448f7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:41.281423 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-682382a0-8348-4b9d-a2ee-f2d438c837ee None None] Network 35c995f2-96ec-4a35-9f59-05221a09df3f requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:00:41.291146 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-d92e474c-37d7-4fa0-a8d8-f67eb19448f7 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3119030 Sep 01 17:00:41.293872 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 55270) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:41.298333 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:41.301374 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95440591-913a-4e77-a592-7e5abd4445e0 req-ca2b096f-42e7-4525-9bf9-bf9be095d4ff tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:41.302947 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-95440591-913a-4e77-a592-7e5abd4445e0 req-ca2b096f-42e7-4525-9bf9-bf9be095d4ff tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 948 time: 0.0565562 Sep 01 17:00:41.320194 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1827089', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4631'] for router, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:41.320744 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1833975', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1833092', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1830247', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4608'] for router, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:41.343619 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-95440591-913a-4e77-a592-7e5abd4445e0 req-8bbf58f7-d175-4e00-bc09-22e3b4f0fb91 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336790 Sep 01 17:00:41.380690 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:41.430867 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ce91fdb-f9d4-529e-8715-29775a2007ca-35c995f2-96ec-4a35-9f59-05221a09df3f', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c'}]}} from dv-cinder-799668-16-iscsi. {{(pid=93837) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 01 17:00:41.431861 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:41.518434 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:41.539068 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e44b2ab-35c1-4adf-ac8e-fd1574bff970 req-21bf1815-7f03-4961-b506-59d365c3ff0c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:41.540790 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5e44b2ab-35c1-4adf-ac8e-fd1574bff970 req-21bf1815-7f03-4961-b506-59d365c3ff0c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0496304 Sep 01 17:00:41.570546 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.db_base_plugin_common [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Allocated IP 172.20.0.2 (35c995f2-96ec-4a35-9f59-05221a09df3f/ab89c120-a892-4afa-a645-bf3caf534f7c/c50c0965-304f-4835-94c0-6eae2dda2639) {{(pid=93837) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:00:41.585020 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5e44b2ab-35c1-4adf-ac8e-fd1574bff970 req-b82fc04b-140e-4c85-af2d-f59713a4e428 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377505 Sep 01 17:00:41.713167 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bf2a2a3-eb2f-44ea-9abc-c5b57c7c2c85 req-3458682f-af66-423a-8ec6-5d11a99256a1 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:41.714801 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0bf2a2a3-eb2f-44ea-9abc-c5b57c7c2c85 req-3458682f-af66-423a-8ec6-5d11a99256a1 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0514207 Sep 01 17:00:41.724602 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Notify callbacks [] for port, precommit_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:41.733980 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Transition to ACTIVE for port object c50c0965-304f-4835-94c0-6eae2dda2639 will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:41.750566 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Transition to ACTIVE for port object c50c0965-304f-4835-94c0-6eae2dda2639 will not be triggered until provisioned by entity DHCP. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:41.755022 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0bf2a2a3-eb2f-44ea-9abc-c5b57c7c2c85 req-86d62fd8-6db7-4a93-bafa-182cbf9c54d1 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0337131 Sep 01 17:00:41.755950 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:41.794556 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Network 35c995f2-96ec-4a35-9f59-05221a09df3f is already hosted by enough agents. {{(pid=93837) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:00:41.799412 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.base_scheduler [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Resources bound (agent type, host, resource id): {{(pid=93837) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:00:41.803502 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Received port after_create {{(pid=93837) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:00:41.843686 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Pushing event updated for resources: {'Port': ['ID=c50c0965-304f-4835-94c0-6eae2dda2639,revision_number=1']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:41.876569 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Attempting to bind port c50c0965-304f-4835-94c0-6eae2dda2639 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:00:41.876949 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Attempting to bind port c50c0965-304f-4835-94c0-6eae2dda2639 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:00:41.877315 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Attempting to bind port c50c0965-304f-4835-94c0-6eae2dda2639 on network 35c995f2-96ec-4a35-9f59-05221a09df3f {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:00:41.883631 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 0, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:00:41.884010 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Checking segment: {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:00:41.884417 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:41.884815 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Bound using segment: {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:00:41.887425 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Bound port: c50c0965-304f-4835-94c0-6eae2dda2639, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:00:41.887425 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:41.927978 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-627507f3-1455-49d6-bd73-bfea620a3964 req-be7d23f6-232d-41dd-b225-c97e883765d7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:41.933411 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:41.935393 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-627507f3-1455-49d6-bd73-bfea620a3964 req-be7d23f6-232d-41dd-b225-c97e883765d7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 931 time: 0.0613611 Sep 01 17:00:41.954558 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:41.959468 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] For port c50c0965-304f-4835-94c0-6eae2dda2639, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:00:41.964335 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] For port c50c0965-304f-4835-94c0-6eae2dda2639, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=c50c0965-304f-4835-94c0-6eae2dda2639,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:00:41.968862 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:42.004174 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-627507f3-1455-49d6-bd73-bfea620a3964 req-eaf1aaaf-91d0-4747-8fe0-69beef42be54 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0678506 Sep 01 17:00:42.021193 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c899ca3-cfb8-41e8-a6ed-82c83291cd35 req-3165e6cc-c2d6-4f6e-aa5d-5960924cd0ea tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:42.027707 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3c899ca3-cfb8-41e8-a6ed-82c83291cd35 req-3165e6cc-c2d6-4f6e-aa5d-5960924cd0ea tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 944 time: 0.0850825 Sep 01 17:00:42.049825 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a2c158-b70a-409e-ab63-dc97af86a75d None None] Pushing event updated for resources: {'Port': ['ID=c50c0965-304f-4835-94c0-6eae2dda2639,revision_number=2']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:42.115690 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Allocated IP 172.27.1.44 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/e5819620-e43f-42d0-85da-97b9b3af57ed) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:00:42.197228 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['3890e11d-5295-488a-9033-9814bb94bf69', '0cf2eaec-e9b1-4ad6-a894-84361c0fe80f'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:00:42.216522 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Request body: {'port': {'device_id': '0239f1a0-a747-468c-b1c3-baae21f2e1ae', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:42.310477 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3c899ca3-cfb8-41e8-a6ed-82c83291cd35 req-2916471e-e8fb-4d4f-95b9-3fab234fc6b9 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2818530 Sep 01 17:00:42.361092 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:42.408307 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:42.426708 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae23e9fd-a4f3-4b66-b2c8-6152f3899729 req-8972d940-76e4-4f1b-bf67-4e514eb8d150 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:42.428389 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-ae23e9fd-a4f3-4b66-b2c8-6152f3899729 req-8972d940-76e4-4f1b-bf67-4e514eb8d150 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d2a03b2bcd68480a8a5796825671a2f1&device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 1101 time: 0.1694243 Sep 01 17:00:42.428958 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:42.455529 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device c50c0965-304f-4835-94c0-6eae2dda2639 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:42.484834 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64e4e32b-d8ed-495f-a6c5-cb00a6d97d55 req-26df1d4b-75b6-4df8-8dee-bffd1a36411e tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:42.486654 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-64e4e32b-d8ed-495f-a6c5-cb00a6d97d55 req-26df1d4b-75b6-4df8-8dee-bffd1a36411e tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 948 time: 0.0603490 Sep 01 17:00:42.517786 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:00:42.522988 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-ae23e9fd-a4f3-4b66-b2c8-6152f3899729 req-635bf02c-3414-4562-b5ac-1284b6f56375 service neutron] 10.222.0.69 "GET /v2.0/networks?tenant_id=d2a03b2bcd68480a8a5796825671a2f1&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0609689 Sep 01 17:00:42.527272 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:00:42.532580 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-64e4e32b-d8ed-495f-a6c5-cb00a6d97d55 req-1aeb22be-dece-4cc7-8f54-87b80fe9571f tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0370364 Sep 01 17:00:42.536930 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:00:42.561906 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Pushing event updated for resources: {'Port': ['ID=e5819620-e43f-42d0-85da-97b9b3af57ed,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:42.562890 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port c50c0965-304f-4835-94c0-6eae2dda2639 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:42.717316 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dade6558-9471-48b6-90d9-33188cc0a5c2 req-95a29d84-8eeb-4644-b4db-2b74bf556c51 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:42.719059 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-dade6558-9471-48b6-90d9-33188cc0a5c2 req-95a29d84-8eeb-4644-b4db-2b74bf556c51 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0531454 Sep 01 17:00:42.759722 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-dade6558-9471-48b6-90d9-33188cc0a5c2 req-b0cefe04-8a59-44a6-b5fd-1315282b9122 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0342855 Sep 01 17:00:42.864834 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae23e9fd-a4f3-4b66-b2c8-6152f3899729 req-e6184db4-9696-4951-98db-813fc47bfce3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:42.866363 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-ae23e9fd-a4f3-4b66-b2c8-6152f3899729 req-e6184db4-9696-4951-98db-813fc47bfce3 service neutron] 10.222.0.69 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3071396 Sep 01 17:00:42.893569 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-098c97e4-3a33-4085-be58-6d6cad748385 req-43ad11e5-08c4-479c-be04-cbaee4df9178 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:42.895295 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-098c97e4-3a33-4085-be58-6d6cad748385 req-43ad11e5-08c4-479c-be04-cbaee4df9178 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0635951 Sep 01 17:00:42.943796 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-098c97e4-3a33-4085-be58-6d6cad748385 req-637f05e1-3c78-4f69-9494-602a2899f994 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0348585 Sep 01 17:00:43.092082 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1958755b-c631-48a6-aa3e-c5b38310b00f None None] Network 35c995f2-96ec-4a35-9f59-05221a09df3f requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:00:43.098409 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-7e7ee382-8aa7-46d0-995c-2354a6e4fda9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:43.099938 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-7e7ee382-8aa7-46d0-995c-2354a6e4fda9 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=d2a03b2bcd68480a8a5796825671a2f1&device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 1101 time: 0.1527195 Sep 01 17:00:43.106956 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:00:43.123013 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:43.124974 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:43.137078 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a4e9bc-74f4-4afe-a06d-70411887af43 req-3b61a0bc-de03-4ebe-b86b-a5ab3c76b367 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:43.139226 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f6a4e9bc-74f4-4afe-a06d-70411887af43 req-3b61a0bc-de03-4ebe-b86b-a5ab3c76b367 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 931 time: 0.0521424 Sep 01 17:00:43.190624 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f6a4e9bc-74f4-4afe-a06d-70411887af43 req-d19dd2bb-7cac-43d1-bf52-376337b724ff tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401294 Sep 01 17:00:43.197547 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-bd2449a8-982d-499b-9ef2-e57d2e78ab7a None None] Provisioning for port c50c0965-304f-4835-94c0-6eae2dda2639 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:43.210529 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-d5435ee5-52bc-47cc-9ddd-aabd92d55630 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.187&port_id=1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 HTTP/1.1" status: 200 len: 217 time: 0.0990367 Sep 01 17:00:43.223050 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-bd2449a8-982d-499b-9ef2-e57d2e78ab7a None None] Provisioning complete for port c50c0965-304f-4835-94c0-6eae2dda2639 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:43.223241 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Transition to ACTIVE for port object 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:43.223590 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-bd2449a8-982d-499b-9ef2-e57d2e78ab7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:43.255565 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:43.364833 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-bd2449a8-982d-499b-9ef2-e57d2e78ab7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:43.368138 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-45c96b6d-d0b1-4dd4-a7f8-8aa29fb21306 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:43.369665 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-45c96b6d-d0b1-4dd4-a7f8-8aa29fb21306 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=1e312bda-993b-4495-b01a-9110a964ebd6 HTTP/1.1" status: 200 len: 843 time: 0.1492102 Sep 01 17:00:43.376560 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Pushing event updated for resources: {'Port': ['ID=7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:43.416114 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-bd2449a8-982d-499b-9ef2-e57d2e78ab7a None None] For port c50c0965-304f-4835-94c0-6eae2dda2639, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=c50c0965-304f-4835-94c0-6eae2dda2639,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:43.427481 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-bd2449a8-982d-499b-9ef2-e57d2e78ab7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:43.506480 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f8abee-c450-4325-9389-baf6efca1d38 req-95e17af4-80e4-42bb-bb48-5b1ca2f74e56 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:43.516279 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-05f8abee-c450-4325-9389-baf6efca1d38 req-95e17af4-80e4-42bb-bb48-5b1ca2f74e56 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 944 time: 0.0863731 Sep 01 17:00:43.538990 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd2449a8-982d-499b-9ef2-e57d2e78ab7a None None] Pushing event updated for resources: {'Port': ['ID=c50c0965-304f-4835-94c0-6eae2dda2639,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:43.577979 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-545c2f93-ad2f-4285-9629-95b3d5178462 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:43.580536 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-545c2f93-ad2f-4285-9629-95b3d5178462 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=e9938d8d-ca3e-435d-b9ce-6643cd80643e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1179 time: 0.2001333 Sep 01 17:00:43.581780 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Attempting to bind port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:00:43.582113 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Attempting to bind port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:00:43.582654 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Attempting to bind port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc on network 8331b65a-166e-454c-a3c5-ed861dc82dfc {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:00:43.596426 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-05f8abee-c450-4325-9389-baf6efca1d38 req-92600dbf-868e-45a5-83d0-3494c8213940 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0742559 Sep 01 17:00:43.617331 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc on network 8331b65a-166e-454c-a3c5-ed861dc82dfc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:00:43.617871 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Attempting to bind port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc on network 8331b65a-166e-454c-a3c5-ed861dc82dfc {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:00:43.654662 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-30b83a94-7650-402a-98e4-ae665143322d None None] Provisioning complete for port c50c0965-304f-4835-94c0-6eae2dda2639 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:43.655240 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-30b83a94-7650-402a-98e4-ae665143322d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:43.660494 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 0, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:00:43.660841 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Checking segment: {'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:00:43.661235 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Bound using segment: {'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:00:43.661710 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Bound port: 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:00:43.662070 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:43.664307 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1833934', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1833207'] for router, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:43.703456 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5026be-d0c8-4e13-9969-76d34268a62e req-9d1485aa-d341-464e-8fca-18eaff368cff tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:43.705311 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ec5026be-d0c8-4e13-9969-76d34268a62e req-9d1485aa-d341-464e-8fca-18eaff368cff tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 948 time: 0.0625405 Sep 01 17:00:43.763973 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ec5026be-d0c8-4e13-9969-76d34268a62e req-a749cbeb-5cfa-40c1-8339-ccfe171f995b tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488985 Sep 01 17:00:43.891279 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8359bed-0d5c-4708-864e-19a6f88960f0 req-cabc8eef-cb66-4766-ae39-bea77176cb2b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:43.893921 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a8359bed-0d5c-4708-864e-19a6f88960f0 req-cabc8eef-cb66-4766-ae39-bea77176cb2b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0544941 Sep 01 17:00:43.939483 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a8359bed-0d5c-4708-864e-19a6f88960f0 req-8e5c68b3-7999-4ecb-b8a1-3a6b5b38c18b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0362120 Sep 01 17:00:44.023017 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-691c8c28-52b3-45c4-a41a-012367774783 service neutron] 10.222.0.69 "GET /v2.0/networks/e9938d8d-ca3e-435d-b9ce-6643cd80643e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4308906 Sep 01 17:00:44.052796 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] For port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:00:44.089771 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e443fb3a-21b2-410c-a5e8-e012e7f6b7e3 req-89635248-98a9-4ca6-9c4c-915c4d1444a0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:44.091268 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e443fb3a-21b2-410c-a5e8-e012e7f6b7e3 req-89635248-98a9-4ca6-9c4c-915c4d1444a0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0697219 Sep 01 17:00:44.108416 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] For port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:00:44.117406 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:44.132105 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e443fb3a-21b2-410c-a5e8-e012e7f6b7e3 req-5a7b9f9b-8948-469c-b135-01ea6c8bc7a3 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0349295 Sep 01 17:00:44.176612 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:44.177225 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:44.177808 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 6f9364de-2626-4bc4-828f-69a19d15adc9 up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:44.178640 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] 10.222.0.69 "PUT /v2.0/ports/7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc HTTP/1.1" status: 200 len: 1093 time: 1.9699998 Sep 01 17:00:44.182942 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0239f1a0-a747-468c-b1c3-baae21f2e1ae', 'tag': '7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:00:44.185161 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1ee7d242-2443-4cca-bd0f-726ec04602be" -d '{"events": [{"name": "network-changed", "server_uuid": "0239f1a0-a747-468c-b1c3-baae21f2e1ae", "tag": "7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:00:44.225877 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4a123dc-483b-4abf-97dc-8a310d555789 service neutron] Pushing event updated for resources: {'Port': ['ID=7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:44.230829 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-56c6e28c-4d95-4744-98e0-c05c77fc4e16 req-c8b717a7-9e75-4b64-b920-ee40fffdecd8 service neutron] 10.222.0.69 "GET /v2.0/networks/e9938d8d-ca3e-435d-b9ce-6643cd80643e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1958795 Sep 01 17:00:44.241424 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab is scheduled to L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c with binding_index 1 {{(pid=93835) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 01 17:00:44.244694 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port 6f9364de-2626-4bc4-828f-69a19d15adc9 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:44.246519 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:00:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ea3bda5f-3ede-4afc-8f8c-bcbd80717b26 x-openstack-request-id: req-ea3bda5f-3ede-4afc-8f8c-bcbd80717b26 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:00:44.246810 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0239f1a0-a747-468c-b1c3-baae21f2e1ae", "tag": "7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:00:44.247063 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-ea3bda5f-3ede-4afc-8f8c-bcbd80717b26 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:00:44.247448 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0239f1a0-a747-468c-b1c3-baae21f2e1ae', 'tag': '7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc', 'status': 'completed', 'code': 200} Sep 01 17:00:44.250158 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port 6f9364de-2626-4bc4-828f-69a19d15adc9 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:44.251314 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:44.356595 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:44.370547 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-1b8ba3aa-8a6c-4b86-82eb-8592d44760bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:44.372063 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-1b8ba3aa-8a6c-4b86-82eb-8592d44760bb service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7032b30e75954f8da9ad2cb64f1f5ad1&device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 1096 time: 0.1179979 Sep 01 17:00:44.385877 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f9364de-2626-4bc4-828f-69a19d15adc9'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:00:44.388103 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-642aba29-b219-4f11-b9e0-e6b2e74dbade" -d '{"events": [{"server_uuid": "f84d355d-ae15-4f65-860a-2ccf43911f7e", "name": "network-vif-plugged", "status": "completed", "tag": "6f9364de-2626-4bc4-828f-69a19d15adc9"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:00:44.395246 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62559f83-b9e9-4ec8-8a4e-d5226162b821 req-a1e08508-6c27-4373-8655-1838f38dceae tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:44.397333 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device c50c0965-304f-4835-94c0-6eae2dda2639 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:44.405494 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-62559f83-b9e9-4ec8-8a4e-d5226162b821 req-a1e08508-6c27-4373-8655-1838f38dceae tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 943 time: 0.0908961 Sep 01 17:00:44.424020 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-c12a57bf-e5d0-48b9-a662-4fdab5f4a71b service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc HTTP/1.1" status: 200 len: 217 time: 0.0398262 Sep 01 17:00:44.427886 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:00:44.430016 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 6f9364de-2626-4bc4-828f-69a19d15adc9, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=6f9364de-2626-4bc4-828f-69a19d15adc9,segment=NetworkSegment(bd15a57e-34c6-42ac-abbb-bea94ad6f705),segment_id=bd15a57e-34c6-42ac-abbb-bea94ad6f705)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:44.443040 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Sync routers for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:00:44.459726 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:00:44.460498 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:00:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:44.462353 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:44.477674 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-62559f83-b9e9-4ec8-8a4e-d5226162b821 req-954c8b81-0184-4686-a300-b1ec075d4927 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698607 Sep 01 17:00:44.486244 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:00:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4f2d56f-07b1-434d-888d-f506fced272a x-openstack-request-id: req-e4f2d56f-07b1-434d-888d-f506fced272a {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:00:44.490990 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f84d355d-ae15-4f65-860a-2ccf43911f7e", "name": "network-vif-plugged", "status": "completed", "tag": "6f9364de-2626-4bc4-828f-69a19d15adc9", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:00:44.491500 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-e4f2d56f-07b1-434d-888d-f506fced272a {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:00:44.492516 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f9364de-2626-4bc4-828f-69a19d15adc9', 'code': 200} Sep 01 17:00:44.494373 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] Notify callbacks [] for router, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:44.496278 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-d17de123-184f-4361-84be-cff79fe35b36 admin admin] 10.222.0.67 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 3.2013552 Sep 01 17:00:44.499143 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 55348) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:44.549920 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-8e6cbea0-b9ad-496a-9dfb-3e36b3855128 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:44.551412 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-8e6cbea0-b9ad-496a-9dfb-3e36b3855128 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd025a14-8839-4451-a03e-bc7daeb612d0 HTTP/1.1" status: 200 len: 854 time: 0.1179659 Sep 01 17:00:44.557006 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=6f9364de-2626-4bc4-828f-69a19d15adc9,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:44.560115 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port c50c0965-304f-4835-94c0-6eae2dda2639 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:44.560560 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:44.602245 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-f6809d92-2b9b-40b1-96d7-d20e54da85ba service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8331b65a-166e-454c-a3c5-ed861dc82dfc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0424094 Sep 01 17:00:44.641193 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:00:44.725548 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e94809b9-f8f3-4c2f-b80b-24d3b887a4e4 req-03edfae2-e709-4a5f-b813-5dc7f2e4d30f tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:44.728499 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e94809b9-f8f3-4c2f-b80b-24d3b887a4e4 req-03edfae2-e709-4a5f-b813-5dc7f2e4d30f tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 945 time: 0.0510755 Sep 01 17:00:44.772650 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e94809b9-f8f3-4c2f-b80b-24d3b887a4e4 req-38727568-bfad-47bc-ab0c-f74884ee7403 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360184 Sep 01 17:00:44.780518 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-250ff376-932f-48b7-a404-48d502fc1162 req-283e7de3-925d-46a7-b85d-9f8865dec5f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:44.782070 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-250ff376-932f-48b7-a404-48d502fc1162 req-283e7de3-925d-46a7-b85d-9f8865dec5f6 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 1098 time: 0.0996554 Sep 01 17:00:44.888449 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16bd33e7-3945-49b5-a48d-24404c369a11 req-56d00842-5eb3-43d5-b2c1-713165576221 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:44.889905 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-16bd33e7-3945-49b5-a48d-24404c369a11 req-56d00842-5eb3-43d5-b2c1-713165576221 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 948 time: 0.0509264 Sep 01 17:00:44.903413 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-e2a96522-2a72-4591-bb65-f580203b9215 service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2441592 Sep 01 17:00:44.911807 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-250ff376-932f-48b7-a404-48d502fc1162 req-7aee2fa1-c47a-4a34-b7c0-dc767a32ebb2 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0919485 Sep 01 17:00:44.915405 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:42Z', 'revision_number': 3, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:42Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:44.932038 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-16bd33e7-3945-49b5-a48d-24404c369a11 req-0cefafa3-6d41-49a4-9ecc-b4d9a5525828 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355337 Sep 01 17:00:44.942398 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Checking router: 8724afe3-ad3a-4d4f-94c4-4642b6e0afab for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:00:44.942754 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Updating router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab port e5819620-e43f-42d0-85da-97b9b3af57ed binding host dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 17:00:44.967404 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:45.077853 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dc8464d-a713-4f3f-bff3-c721f3b2b061 req-a5d732a6-27a8-4815-84fb-e0ff276294c7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:45.079452 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9dc8464d-a713-4f3f-bff3-c721f3b2b061 req-a5d732a6-27a8-4815-84fb-e0ff276294c7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0588002 Sep 01 17:00:45.106667 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60c3178f-f723-4bbf-a674-1b364e94cba4 req-a6574c63-e840-4353-ac8e-faedbb6432b5 service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1918943 Sep 01 17:00:45.133875 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9dc8464d-a713-4f3f-bff3-c721f3b2b061 req-42c1f859-cb8a-4ee9-ab11-3ad209d01db9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409625 Sep 01 17:00:45.279965 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7559a3f-c065-4205-9e0e-16d08d2cb954 req-88088a47-f424-42c1-afbb-d2a745edfa3f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:45.281510 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d7559a3f-c065-4205-9e0e-16d08d2cb954 req-88088a47-f424-42c1-afbb-d2a745edfa3f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0561712 Sep 01 17:00:45.295128 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:45.299370 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee7d242-2443-4cca-bd0f-726ec04602be req-7bea49c8-1b0c-4f64-8958-b4631eb1bda4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:45.300117 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Notify callbacks [] for port, precommit_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:45.301332 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-1ee7d242-2443-4cca-bd0f-726ec04602be req-7bea49c8-1b0c-4f64-8958-b4631eb1bda4 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7032b30e75954f8da9ad2cb64f1f5ad1&device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 1096 time: 0.0823164 Sep 01 17:00:45.312439 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.provisioning_blocks [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Transition to ACTIVE for port object e5819620-e43f-42d0-85da-97b9b3af57ed will not be triggered until provisioned by entity L2. {{(pid=93838) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:45.319076 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:45.325985 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d7559a3f-c065-4205-9e0e-16d08d2cb954 req-f080d40a-a9a7-4345-8821-b63b1a69b9e3 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384529 Sep 01 17:00:45.379885 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Attempting to bind port e5819620-e43f-42d0-85da-97b9b3af57ed on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:00:45.380258 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Attempting to bind port e5819620-e43f-42d0-85da-97b9b3af57ed by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:00:45.380622 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Attempting to bind port e5819620-e43f-42d0-85da-97b9b3af57ed on network e28b8145-06a4-43a8-a9f2-9a7014f96a23 {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:00:45.389948 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 0, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:00:45.390321 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Checking segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93838) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:00:45.390718 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:45.391129 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Bound using segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:00:45.391591 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Bound port: e5819620-e43f-42d0-85da-97b9b3af57ed, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:00:45.391983 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:45.394342 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b001c71-4d60-4429-a5c3-0a7b0dd34f64 None None] Pushing event updated for resources: {'Port': ['ID=e5819620-e43f-42d0-85da-97b9b3af57ed,revision_number=2']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:45.423335 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b001c71-4d60-4429-a5c3-0a7b0dd34f64 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:45.423657 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b001c71-4d60-4429-a5c3-0a7b0dd34f64 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:45.423978 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b001c71-4d60-4429-a5c3-0a7b0dd34f64 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:45.424286 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b001c71-4d60-4429-a5c3-0a7b0dd34f64 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:45.424612 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b001c71-4d60-4429-a5c3-0a7b0dd34f64 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:45.424972 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b001c71-4d60-4429-a5c3-0a7b0dd34f64 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:45.425269 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b001c71-4d60-4429-a5c3-0a7b0dd34f64 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:45.425659 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b001c71-4d60-4429-a5c3-0a7b0dd34f64 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:45.425997 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b001c71-4d60-4429-a5c3-0a7b0dd34f64 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:45.426324 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b001c71-4d60-4429-a5c3-0a7b0dd34f64 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:45.426642 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b001c71-4d60-4429-a5c3-0a7b0dd34f64 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:45.426967 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b001c71-4d60-4429-a5c3-0a7b0dd34f64 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:00:45.462326 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] For port e5819620-e43f-42d0-85da-97b9b3af57ed, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93838) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:00:45.466540 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] For port e5819620-e43f-42d0-85da-97b9b3af57ed, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=e5819620-e43f-42d0-85da-97b9b3af57ed,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93838) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:00:45.472768 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:45.493942 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee7d242-2443-4cca-bd0f-726ec04602be req-718ed66b-659a-4646-bb6f-5ed2be7cf342 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:45.495604 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-1ee7d242-2443-4cca-bd0f-726ec04602be req-718ed66b-659a-4646-bb6f-5ed2be7cf342 service neutron] 10.222.0.69 "GET /v2.0/networks?id=8331b65a-166e-454c-a3c5-ed861dc82dfc HTTP/1.1" status: 200 len: 915 time: 0.1836889 Sep 01 17:00:45.523763 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:00:45.524415 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:00:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:45.568282 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-1ee7d242-2443-4cca-bd0f-726ec04602be req-5295d10c-1e8f-4132-be6f-e00f7b6818fd service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc HTTP/1.1" status: 200 len: 217 time: 0.0407591 Sep 01 17:00:45.575742 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b001c71-4d60-4429-a5c3-0a7b0dd34f64 None None] Pushing event updated for resources: {'Port': ['ID=e5819620-e43f-42d0-85da-97b9b3af57ed,revision_number=3']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:45.583677 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Allocated IP 172.20.0.1 (35c995f2-96ec-4a35-9f59-05221a09df3f/ab89c120-a892-4afa-a645-bf3caf534f7c/9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:00:45.627760 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4623eb92-e78f-459b-a26e-b7468689a980 req-930420f4-debe-4cb7-92a8-86ee8e2bbe4f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:45.636605 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4623eb92-e78f-459b-a26e-b7468689a980 req-930420f4-debe-4cb7-92a8-86ee8e2bbe4f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 943 time: 0.0742466 Sep 01 17:00:45.681627 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4623eb92-e78f-459b-a26e-b7468689a980 req-e4db078c-21bb-49bf-9c53-f9bf53603a41 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437644 Sep 01 17:00:45.686681 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee7d242-2443-4cca-bd0f-726ec04602be req-6ba63851-df58-46f5-9a01-52c511431071 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:45.688382 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-1ee7d242-2443-4cca-bd0f-726ec04602be req-6ba63851-df58-46f5-9a01-52c511431071 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd025a14-8839-4451-a03e-bc7daeb612d0 HTTP/1.1" status: 200 len: 854 time: 0.1021152 Sep 01 17:00:45.707402 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:00:45.772594 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-1ee7d242-2443-4cca-bd0f-726ec04602be req-da13bb4a-4d89-467d-bf91-005441de4107 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8331b65a-166e-454c-a3c5-ed861dc82dfc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0635998 Sep 01 17:00:45.779229 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:45.851018 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Transition to ACTIVE for port object 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:45.914821 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92663a4d-f7a9-44d9-afdf-451263cc09c6 req-d1f6d1f0-c36a-4fd8-aba1-34c9096946cf tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:45.918061 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-92663a4d-f7a9-44d9-afdf-451263cc09c6 req-d1f6d1f0-c36a-4fd8-aba1-34c9096946cf tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 945 time: 0.0585582 Sep 01 17:00:45.927066 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-1ee7d242-2443-4cca-bd0f-726ec04602be req-23af0a3f-b251-430e-b34a-d6aab2bae15f service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1396050 Sep 01 17:00:45.928672 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:45.934569 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:42Z', 'revision_number': 3, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:45.962558 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-92663a4d-f7a9-44d9-afdf-451263cc09c6 req-85b3c775-7073-4e13-aae2-d475534ecaec tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399315 Sep 01 17:00:45.966142 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-043ac0c4-513c-47d0-9a1a-63b23bf734e8 None None] The sync data for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi is: [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:42Z', 'revision_number': 3, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:00:46.073175 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a09bf08-18df-40e9-811e-cfd0f9d050e1 req-280cb6bc-2f1c-4229-8f4d-3c00dd2dd9e5 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:46.078027 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7a09bf08-18df-40e9-811e-cfd0f9d050e1 req-280cb6bc-2f1c-4229-8f4d-3c00dd2dd9e5 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 948 time: 0.0578418 Sep 01 17:00:46.120553 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7a09bf08-18df-40e9-811e-cfd0f9d050e1 req-5af86f97-dc37-4509-a407-81b7f30b19eb tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394826 Sep 01 17:00:46.253893 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Network 35c995f2-96ec-4a35-9f59-05221a09df3f is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:00:46.263274 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:00:46.267451 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:00:46.269464 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Pushing event updated for resources: {'Port': ['ID=9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:46.330575 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4961561-5d71-4b4c-b99a-16b63461ca2b req-1e867bb7-dc33-4854-b3d9-45504a78be25 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:46.333571 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c4961561-5d71-4b4c-b99a-16b63461ca2b req-1e867bb7-dc33-4854-b3d9-45504a78be25 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.1348786 Sep 01 17:00:46.399566 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c4961561-5d71-4b4c-b99a-16b63461ca2b req-07753a61-152f-45d8-b633-d20786c510e6 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0584002 Sep 01 17:00:46.422254 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1827972'] for router_interface, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:46.444603 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device e5819620-e43f-42d0-85da-97b9b3af57ed up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:46.446676 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-1ee7d242-2443-4cca-bd0f-726ec04602be req-2e187e9f-18ff-4106-9a1d-29a592ade146 service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4918833 Sep 01 17:00:46.516539 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port e5819620-e43f-42d0-85da-97b9b3af57ed completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:46.522682 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port e5819620-e43f-42d0-85da-97b9b3af57ed triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:46.525851 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:46.615106 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:46.641777 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-9e47d3ea-1c89-4c92-b5f4-79a9f379f9c5 None None] Provisioning for port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:46.645476 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:46.653101 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-9e47d3ea-1c89-4c92-b5f4-79a9f379f9c5 None None] Provisioning complete for port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:46.654051 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-9e47d3ea-1c89-4c92-b5f4-79a9f379f9c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:46.711779 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port e5819620-e43f-42d0-85da-97b9b3af57ed, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=e5819620-e43f-42d0-85da-97b9b3af57ed,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:46.719079 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:46.728858 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-9e47d3ea-1c89-4c92-b5f4-79a9f379f9c5 None None] Port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:00:46.780749 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=e5819620-e43f-42d0-85da-97b9b3af57ed,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:46.810319 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:46.815874 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:46.824932 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e57c12d-6505-4371-94b9-8032403858cc req-78d560ac-16be-4345-bd4d-2aaf2d268766 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:46.826639 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5e57c12d-6505-4371-94b9-8032403858cc req-78d560ac-16be-4345-bd4d-2aaf2d268766 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 943 time: 0.0582714 Sep 01 17:00:46.873990 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5e57c12d-6505-4371-94b9-8032403858cc req-2e51047e-6d95-45d4-8f85-698ad77c70b7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409343 Sep 01 17:00:46.896026 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611336', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1832500'] for router_interface, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:46.898098 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Pushing event updated for resources: {'Port': ['ID=9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:47.000921 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Network 35c995f2-96ec-4a35-9f59-05221a09df3f is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:00:47.002588 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:00:47.107854 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84fe130-7964-4bea-aa41-cec3efb9ddeb req-bd4af14b-d663-43b7-a26e-e410126c65ad tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:47.109370 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a84fe130-7964-4bea-aa41-cec3efb9ddeb req-bd4af14b-d663-43b7-a26e-e410126c65ad tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.1241825 Sep 01 17:00:47.122605 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-472492c5-8ce4-487e-a7f2-6c661df5e117 req-80ee92ff-cd52-485e-8318-13888e31bdd5 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:47.124162 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-472492c5-8ce4-487e-a7f2-6c661df5e117 req-80ee92ff-cd52-485e-8318-13888e31bdd5 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 945 time: 0.0671875 Sep 01 17:00:47.149947 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:00:47.185560 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a84fe130-7964-4bea-aa41-cec3efb9ddeb req-df297cc0-7a22-4046-9d5b-faa522059d1c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0603690 Sep 01 17:00:47.200486 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-472492c5-8ce4-487e-a7f2-6c661df5e117 req-581682a1-820a-425e-8fe8-0df7ae2ced75 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683763 Sep 01 17:00:47.251048 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-d85815af-7e22-4971-b46f-6f8803d8aa14 None None] Provisioning complete for port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:47.252288 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-d85815af-7e22-4971-b46f-6f8803d8aa14 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:47.284489 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:00:47.297984 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-92bed476-afd9-4b71-a83e-319ea2eb942e admin admin] 10.222.0.67 "PUT /v2.0/routers/8724afe3-ad3a-4d4f-94c4-4642b6e0afab/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7977707 Sep 01 17:00:47.320941 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-d85815af-7e22-4971-b46f-6f8803d8aa14 None None] Port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:00:47.329125 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf51374e-81cf-417e-a8ff-f6be7f5a9a75 req-4f42ff4f-2bf2-40b6-98c1-8c15df16294c tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:47.330792 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bf51374e-81cf-417e-a8ff-f6be7f5a9a75 req-4f42ff4f-2bf2-40b6-98c1-8c15df16294c tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 948 time: 0.0612886 Sep 01 17:00:47.373960 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bf51374e-81cf-417e-a8ff-f6be7f5a9a75 req-bee24a5b-e4bd-4aef-9c39-9040b2aa9704 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0364354 Sep 01 17:00:47.491121 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc796d1-2eb2-45a0-bf3b-7f92668fc2a8 req-6b22df58-58f3-4ab8-bae1-79a1932caa6c tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:47.493642 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5dc796d1-2eb2-45a0-bf3b-7f92668fc2a8 req-6b22df58-58f3-4ab8-bae1-79a1932caa6c tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 945 time: 0.0597072 Sep 01 17:00:47.558718 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5dc796d1-2eb2-45a0-bf3b-7f92668fc2a8 req-b6bf1b5e-2262-484c-8471-d20f871a85ee tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0569613 Sep 01 17:00:47.737523 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10064778-d6fc-4898-abe6-a74ed5308f39 req-4239f31b-0c8d-45b7-8b0e-40d8803e9da5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:47.739422 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-10064778-d6fc-4898-abe6-a74ed5308f39 req-4239f31b-0c8d-45b7-8b0e-40d8803e9da5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0955982 Sep 01 17:00:47.811604 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-10064778-d6fc-4898-abe6-a74ed5308f39 req-aae43212-cc7d-49a5-8a75-f0e71d2937f4 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0560987 Sep 01 17:00:47.968406 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 55434) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:47.973773 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-847636729-network', 'tenant_id': '45595a19a07042cda8672bd206162373'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:47.987745 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1d949ef-f8a6-480e-a2ba-2195f8b06fef req-a1238f16-6541-4d94-ab7d-d2939160e0f5 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:47.989264 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e1d949ef-f8a6-480e-a2ba-2195f8b06fef req-a1238f16-6541-4d94-ab7d-d2939160e0f5 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 945 time: 0.0831740 Sep 01 17:00:47.990158 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Sync routers for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:00:48.001784 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:00:48.002647 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:00:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:48.007906 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] Made reservation on behalf of 45595a19a07042cda8672bd206162373 for: {'network': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:00:48.010471 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.011815 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5861e08-b76a-45cc-9426-8260bb3e95ad req-c9940b8b-98dd-4094-9dfc-8419b4fc041a tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:48.013321 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a5861e08-b76a-45cc-9426-8260bb3e95ad req-c9940b8b-98dd-4094-9dfc-8419b4fc041a tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 943 time: 0.0715415 Sep 01 17:00:48.021120 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.080309 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e1d949ef-f8a6-480e-a2ba-2195f8b06fef req-02b9a63d-4c30-4a60-babe-adc17e94cced tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0796592 Sep 01 17:00:48.094462 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a5861e08-b76a-45cc-9426-8260bb3e95ad req-dbd574ba-637c-47ae-867d-94b6f3b7eac8 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0679767 Sep 01 17:00:48.130834 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:00:48.169781 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.174537 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.186072 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] vlan segment allocate from pool success with {'vlan_id': 524, 'physical_network': 'physnet1'} {{(pid=93835) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 17:00:48.205481 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.205784 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.segments_db [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] Added segment b29f5104-3b2d-4e40-af30-f0607bf9318e of type vlan for network 5b6358fd-941d-4575-bad3-2592e08ee13f Sep 01 17:00:48.214893 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:00:48.223701 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ffbe0b26-8c39-4df7-a8db-416b2a40c8cc,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:48.263208 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.297560 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.300236 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:48.300843 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.396574 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] Pushing event updated for resources: {'Network': ['ID=5b6358fd-941d-4575-bad3-2592e08ee13f,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:48.406837 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-bb28745c-eb55-49f9-b821-4d24efe797da admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.4317818 Sep 01 17:00:48.406948 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device e5819620-e43f-42d0-85da-97b9b3af57ed up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:48.407042 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 55440) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:48.409324 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-008e6435-259a-4229-9aa0-cd6ae8e73852 admin admin] Request body: {'subnet': {'network_id': '5b6358fd-941d-4575-bad3-2592e08ee13f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-847636729-subnet', 'tenant_id': '45595a19a07042cda8672bd206162373', 'ip_version': 4}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:48.439920 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-008e6435-259a-4229-9aa0-cd6ae8e73852 admin admin] Made reservation on behalf of 45595a19a07042cda8672bd206162373 for: {'subnet': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:00:48.443408 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-008e6435-259a-4229-9aa0-cd6ae8e73852 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5120093'] for subnet, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.450874 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network 5b6358fd-941d-4575-bad3-2592e08ee13f details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 17:00:48.552418 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cc8af87-476a-4913-9245-9032afd5d302 req-ad194c9c-7626-4a5c-b89c-03a8241bb44b tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:48.554688 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0cc8af87-476a-4913-9245-9032afd5d302 req-ad194c9c-7626-4a5c-b89c-03a8241bb44b tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 948 time: 0.0574625 Sep 01 17:00:48.619665 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0cc8af87-476a-4913-9245-9032afd5d302 req-4390ca6a-32f0-422e-9b33-c02a9a0f68ec tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0562699 Sep 01 17:00:48.642091 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:48.672479 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-008e6435-259a-4229-9aa0-cd6ae8e73852 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7343016', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5120075'] for subnet, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.673568 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': '7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc', 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc', 'port_id': '7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc', 'mac_address': 'fa:16:3e:21:c5:93', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 525, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fd025a14-8839-4451-a03e-bc7daeb612d0', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:00:48.677515 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port e5819620-e43f-42d0-85da-97b9b3af57ed triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:48.677899 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.751261 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-008e6435-259a-4229-9aa0-cd6ae8e73852 admin admin] Pushing event updated for resources: {'Subnet': ['ID=83cfc7d8-6589-4159-a8f7-3faa0a2f904f,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:48.752407 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 2, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:48.760278 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-008e6435-259a-4229-9aa0-cd6ae8e73852 admin admin] Checking segment: {'id': 'b29f5104-3b2d-4e40-af30-f0607bf9318e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '5b6358fd-941d-4575-bad3-2592e08ee13f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:00:48.760278 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-008e6435-259a-4229-9aa0-cd6ae8e73852 admin admin] Network hostable DHCP agents. Network: 5b6358fd-941d-4575-bad3-2592e08ee13f, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93835) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 17:00:48.790100 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Checking router: 8724afe3-ad3a-4d4f-94c4-4642b6e0afab for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:00:48.790482 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Updating router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 binding host dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 17:00:48.791318 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-008e6435-259a-4229-9aa0-cd6ae8e73852 admin admin] Network 5b6358fd-941d-4575-bad3-2592e08ee13f is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93835) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 17:00:48.809895 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-008e6435-259a-4229-9aa0-cd6ae8e73852 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, 5b6358fd-941d-4575-bad3-2592e08ee13f) {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:00:48.812970 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.819865 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-008e6435-259a-4229-9aa0-cd6ae8e73852 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:48.822114 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-008e6435-259a-4229-9aa0-cd6ae8e73852 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.841128 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-008e6435-259a-4229-9aa0-cd6ae8e73852 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.4359293 Sep 01 17:00:48.843838 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 55454) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:48.845942 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7182cfd8-447f-4704-bf15-cc05d5da2584 None None] Network 5b6358fd-941d-4575-bad3-2592e08ee13f requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:00:48.851881 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-847636729-router', 'tenant_id': '45595a19a07042cda8672bd206162373', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:48.880935 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1827089', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4631'] for router, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.882005 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1833975', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1833092', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1830247', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4608'] for router, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.895536 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:00:48.913507 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.961153 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.964276 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:48.988154 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9dfaf28-33a1-44bb-9ee5-a4e39671e75d req-d5da449c-15ae-4006-a1ea-0de06928b366 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:48.990867 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e9dfaf28-33a1-44bb-9ee5-a4e39671e75d req-d5da449c-15ae-4006-a1ea-0de06928b366 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0843799 Sep 01 17:00:48.992828 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:48.993560 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:00:49.018695 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 55458) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:49.052310 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e9dfaf28-33a1-44bb-9ee5-a4e39671e75d req-16e2f950-29f6-4737-adc6-e3367ef08e65 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0541098 Sep 01 17:00:49.137157 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.163138 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-d06a57c3-e614-40eb-9999-bd341eaec3aa admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.205669 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:49.265942 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa0e3be6-3c89-4975-861c-8d625da51986 req-59fff30a-c8a9-4b3a-912a-e3249ef0a694 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:49.267388 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fa0e3be6-3c89-4975-861c-8d625da51986 req-59fff30a-c8a9-4b3a-912a-e3249ef0a694 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 944 time: 0.0790896 Sep 01 17:00:49.319193 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9,segment=NetworkSegment(158e4a10-7bf0-4070-aeaf-6bca65a0cfb8),segment_id=158e4a10-7bf0-4070-aeaf-6bca65a0cfb8)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:49.325117 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ce91fdb-f9d4-529e-8715-29775a2007ca-5b6358fd-941d-4575-bad3-2592e08ee13f', 'network_id': '5b6358fd-941d-4575-bad3-2592e08ee13f', 'tenant_id': '45595a19a07042cda8672bd206162373', 'fixed_ips': [{'subnet_id': '83cfc7d8-6589-4159-a8f7-3faa0a2f904f'}]}} from dv-cinder-799668-16-iscsi. {{(pid=93837) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 01 17:00:49.325978 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.335412 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fa0e3be6-3c89-4975-861c-8d625da51986 req-7978e9f6-a00d-4184-9f9a-27394b582cce tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570295 Sep 01 17:00:49.349453 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-d06a57c3-e614-40eb-9999-bd341eaec3aa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.353663 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': '1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9', 'network_id': 'e9938d8d-ca3e-435d-b9ce-6643cd80643e', 'port_id': '1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9', 'mac_address': 'fa:16:3e:78:77:89', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 533, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1e312bda-993b-4495-b01a-9110a964ebd6', 'ip_address': '192.168.233.187'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:00:49.364299 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-d06a57c3-e614-40eb-9999-bd341eaec3aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.377810 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.398388 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.403809 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-d06a57c3-e614-40eb-9999-bd341eaec3aa admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=60e994c1571d4861bffe5e6065747135&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3840768 Sep 01 17:00:49.404786 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d06a57c3-e614-40eb-9999-bd341eaec3aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a8f6fdec-0e2b-40ac-a2e6-efaca2210762,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:49.408652 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 55464) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:49.463974 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-be9af5b1-d7d3-4759-ba6b-be21ef991430 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.490983 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-be9af5b1-d7d3-4759-ba6b-be21ef991430 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.510020 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.525046 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Allocated IP 172.27.1.177 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/755518de-49ad-448d-91ea-944a89f41331) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:00:49.542953 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:00:49.563927 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-be9af5b1-d7d3-4759-ba6b-be21ef991430 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.568584 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-be9af5b1-d7d3-4759-ba6b-be21ef991430 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.575299 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-be9af5b1-d7d3-4759-ba6b-be21ef991430 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/a8f6fdec-0e2b-40ac-a2e6-efaca2210762 HTTP/1.1" status: 204 len: 168 time: 0.1644979 Sep 01 17:00:49.583899 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be9af5b1-d7d3-4759-ba6b-be21ef991430 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8f6fdec-0e2b-40ac-a2e6-efaca2210762,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:49.594979 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.db_base_plugin_common [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Allocated IP 172.20.0.2 (5b6358fd-941d-4575-bad3-2592e08ee13f/83cfc7d8-6589-4159-a8f7-3faa0a2f904f/2428f97b-7581-4636-8957-db3a5330a720) {{(pid=93837) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:00:49.599088 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9,segment=NetworkSegment(158e4a10-7bf0-4070-aeaf-6bca65a0cfb8),segment_id=158e4a10-7bf0-4070-aeaf-6bca65a0cfb8)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:49.618082 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.667447 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Notify callbacks [] for port, precommit_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.690199 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.736600 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Transition to ACTIVE for port object 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:49.752930 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.755152 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:49.758245 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:49.825597 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Pushing event updated for resources: {'Port': ['ID=755518de-49ad-448d-91ea-944a89f41331,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:49.830963 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:00:49.835946 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:00:49.839112 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:00:49.877406 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1d22a52-4a84-4e75-9b38-c95f3e61e319 None None] Pushing event updated for resources: {'Port': ['ID=9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:49.954834 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b802e24-f985-4f1c-a689-d4265ba1439b req-1427691e-ec4b-4b49-a2eb-5ea83fdeb869 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:49.969373 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0b802e24-f985-4f1c-a689-d4265ba1439b req-1427691e-ec4b-4b49-a2eb-5ea83fdeb869 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 949 time: 0.2119811 Sep 01 17:00:50.000932 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:00:50.003209 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:00:50.050934 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0b802e24-f985-4f1c-a689-d4265ba1439b req-26e73184-a43b-4a97-84e2-807ab2b80fe7 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695899 Sep 01 17:00:50.121473 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Attempting to bind port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:00:50.121845 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Attempting to bind port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:00:50.122561 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Attempting to bind port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 on network 35c995f2-96ec-4a35-9f59-05221a09df3f {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:00:50.137186 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 0, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:00:50.137632 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Checking segment: {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:00:50.138000 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:50.138392 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Bound using segment: {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:00:50.138874 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Bound port: 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:00:50.139256 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:50.159154 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Notify callbacks [] for port, precommit_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:50.205581 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Transition to ACTIVE for port object 2428f97b-7581-4636-8957-db3a5330a720 will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:50.242501 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a45f34f-d472-4a43-9dcb-1a0a6b2e18d0 req-44a5783f-d285-4d17-ae8c-83b98ab96f8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:50.250419 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8a45f34f-d472-4a43-9dcb-1a0a6b2e18d0 req-44a5783f-d285-4d17-ae8c-83b98ab96f8e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0744658 Sep 01 17:00:50.251921 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:50.262945 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Transition to ACTIVE for port object 2428f97b-7581-4636-8957-db3a5330a720 will not be triggered until provisioned by entity DHCP. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:50.294475 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:50.325975 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8a45f34f-d472-4a43-9dcb-1a0a6b2e18d0 req-1cd08e58-9f87-4289-b0c1-c7e116ede83a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0731077 Sep 01 17:00:50.405990 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Network 5b6358fd-941d-4575-bad3-2592e08ee13f is already hosted by enough agents. {{(pid=93837) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:00:50.418275 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] For port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:00:50.423438 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.base_scheduler [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Resources bound (agent type, host, resource id): {{(pid=93837) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:00:50.430893 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Pushing event updated for resources: {'Port': ['ID=2428f97b-7581-4636-8957-db3a5330a720,revision_number=1']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:50.438433 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Received port after_create {{(pid=93837) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:00:50.453981 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] For port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:00:50.468155 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:50.493167 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5815e57b-4aad-42b1-a055-ac87236aa2f6 req-d235189c-b1a7-4b38-95af-d41792fe8dc2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:50.495480 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5815e57b-4aad-42b1-a055-ac87236aa2f6 req-d235189c-b1a7-4b38-95af-d41792fe8dc2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 944 time: 0.0597210 Sep 01 17:00:50.528927 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1833934', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1833207'] for router, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:50.535948 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5815e57b-4aad-42b1-a055-ac87236aa2f6 req-d67c3df2-1ae3-40b0-9bba-05d4f8243a97 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0335708 Sep 01 17:00:50.672900 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Router eaed026e-b8b6-438b-8d43-76d2afcb1335 is scheduled to L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c with binding_index 1 {{(pid=93835) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 01 17:00:50.744476 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Attempting to bind port 2428f97b-7581-4636-8957-db3a5330a720 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:00:50.744844 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Attempting to bind port 2428f97b-7581-4636-8957-db3a5330a720 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': 'b29f5104-3b2d-4e40-af30-f0607bf9318e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '5b6358fd-941d-4575-bad3-2592e08ee13f'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:00:50.745203 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Attempting to bind port 2428f97b-7581-4636-8957-db3a5330a720 on network 5b6358fd-941d-4575-bad3-2592e08ee13f {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:00:50.769444 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:00:50.770086 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:00:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:50.775719 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 0, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:00:50.776110 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Checking segment: {'id': 'b29f5104-3b2d-4e40-af30-f0607bf9318e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '5b6358fd-941d-4575-bad3-2592e08ee13f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:00:50.776494 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:50.776880 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Bound using segment: {'id': 'b29f5104-3b2d-4e40-af30-f0607bf9318e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '5b6358fd-941d-4575-bad3-2592e08ee13f'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:00:50.777343 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Bound port: 2428f97b-7581-4636-8957-db3a5330a720, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b29f5104-3b2d-4e40-af30-f0607bf9318e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '5b6358fd-941d-4575-bad3-2592e08ee13f'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:00:50.777752 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:50.780723 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1d22a52-4a84-4e75-9b38-c95f3e61e319 None None] Pushing event updated for resources: {'Port': ['ID=9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:50.801441 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:00:50.810614 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Sync routers for ids ['eaed026e-b8b6-438b-8d43-76d2afcb1335'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:00:50.821128 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Routers {'eaed026e-b8b6-438b-8d43-76d2afcb1335'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:00:50.822064 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:00:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['eaed026e-b8b6-438b-8d43-76d2afcb1335'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:50.823496 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] Notify callbacks [] for router, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:50.824963 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-2b11f53d-a128-4c81-a3a3-9b22c8b0c3da admin admin] 10.222.0.67 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.9799826 Sep 01 17:00:50.827913 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 55494) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:50.946750 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Set router eaed026e-b8b6-438b-8d43-76d2afcb1335 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:00:50.948539 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] For port 2428f97b-7581-4636-8957-db3a5330a720, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:00:50.953551 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] For port 2428f97b-7581-4636-8957-db3a5330a720, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=2428f97b-7581-4636-8957-db3a5330a720,segment=NetworkSegment(b29f5104-3b2d-4e40-af30-f0607bf9318e),segment_id=b29f5104-3b2d-4e40-af30-f0607bf9318e)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:00:50.964482 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:50.967849 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:00:51.156228 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-872c8be5-6b6d-4900-b0c6-6197e2bcb30f None None] Pushing event updated for resources: {'Port': ['ID=2428f97b-7581-4636-8957-db3a5330a720,revision_number=2']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:51.188736 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'name': 'tempest-TestVolumeBootPattern-847636729-router', 'tenant_id': '45595a19a07042cda8672bd206162373', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.177'}], 'enable_snat': True}, 'gw_port_id': '755518de-49ad-448d-91ea-944a89f41331', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:48Z', 'updated_at': '2021-09-01T17:00:50Z', 'revision_number': 3, 'project_id': '45595a19a07042cda8672bd206162373', 'gw_port': {'id': '755518de-49ad-448d-91ea-944a89f41331', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:e2:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'device_owner': 'network:router_gateway', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:49Z', 'updated_at': '2021-09-01T17:00:49Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:51.218937 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Checking router: eaed026e-b8b6-438b-8d43-76d2afcb1335 for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:00:51.219286 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Updating router eaed026e-b8b6-438b-8d43-76d2afcb1335 port 755518de-49ad-448d-91ea-944a89f41331 binding host dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 17:00:51.246371 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:51.271516 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-89e3a82f-7ba2-4f49-9f94-e20b6587f6d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:51.298763 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c82eecd2-238f-4473-9bbf-335792a791e4 req-0a71c81e-1dff-4a4c-b38a-07bb03e3684d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:51.306828 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c82eecd2-238f-4473-9bbf-335792a791e4 req-0a71c81e-1dff-4a4c-b38a-07bb03e3684d tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 949 time: 0.1192625 Sep 01 17:00:51.324369 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:50Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:51.374594 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49d74585-31c5-4668-b12b-b488df91f973 None None] The sync data for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi is: [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:50Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:00:51.418640 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c82eecd2-238f-4473-9bbf-335792a791e4 req-85827dfb-0680-4412-bdbf-22bdae95a4a5 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1109748 Sep 01 17:00:51.453117 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:51.557451 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-482448a5-1e9f-47c3-85bd-9a8278c655c3 req-25a4be3a-a95d-42c0-969e-1f7fff697380 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:51.559289 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-482448a5-1e9f-47c3-85bd-9a8278c655c3 req-25a4be3a-a95d-42c0-969e-1f7fff697380 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.1344390 Sep 01 17:00:51.667095 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Notify callbacks [] for port, precommit_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:51.679147 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.provisioning_blocks [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Transition to ACTIVE for port object 755518de-49ad-448d-91ea-944a89f41331 will not be triggered until provisioned by entity L2. {{(pid=93838) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:51.685966 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:51.694173 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-482448a5-1e9f-47c3-85bd-9a8278c655c3 req-f44841ff-6258-4a9b-baee-0fe750e1d038 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0945733 Sep 01 17:00:51.734782 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-766c3056-a823-4a0c-bd99-12f529b829cd req-8a30357b-ef4e-4657-9836-028eaf152949 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:51.736626 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-766c3056-a823-4a0c-bd99-12f529b829cd req-8a30357b-ef4e-4657-9836-028eaf152949 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 944 time: 0.1126418 Sep 01 17:00:51.746549 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Attempting to bind port 755518de-49ad-448d-91ea-944a89f41331 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:00:51.746909 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Attempting to bind port 755518de-49ad-448d-91ea-944a89f41331 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:00:51.747272 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Attempting to bind port 755518de-49ad-448d-91ea-944a89f41331 on network e28b8145-06a4-43a8-a9f2-9a7014f96a23 {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:00:51.760797 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 0, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:00:51.761507 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Checking segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93838) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:00:51.761645 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:51.762028 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Bound using segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:00:51.762516 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Bound port: 755518de-49ad-448d-91ea-944a89f41331, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:00:51.762914 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:51.791350 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c20aff6a-20aa-442e-9529-f038e587d451 None None] Pushing event updated for resources: {'Port': ['ID=755518de-49ad-448d-91ea-944a89f41331,revision_number=2']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:51.802469 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Allocated IP 172.20.0.1 (5b6358fd-941d-4575-bad3-2592e08ee13f/83cfc7d8-6589-4159-a8f7-3faa0a2f904f/51fab0de-35b9-4df2-9417-4ecf2e7d519e) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:00:51.813002 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-766c3056-a823-4a0c-bd99-12f529b829cd req-1a1a7e44-4735-44ea-8839-7b667b011b3b tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584102 Sep 01 17:00:51.826979 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] For port 755518de-49ad-448d-91ea-944a89f41331, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93838) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:00:51.836209 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] For port 755518de-49ad-448d-91ea-944a89f41331, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=755518de-49ad-448d-91ea-944a89f41331,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93838) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:00:51.842524 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:51.906808 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Routers {'eaed026e-b8b6-438b-8d43-76d2afcb1335'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:00:51.907446 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:00:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['eaed026e-b8b6-438b-8d43-76d2afcb1335'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:51.909425 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c20aff6a-20aa-442e-9529-f038e587d451 None None] Pushing event updated for resources: {'Port': ['ID=755518de-49ad-448d-91ea-944a89f41331,revision_number=3']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:51.914760 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:51.929127 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.provisioning_blocks [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Transition to ACTIVE for port object 51fab0de-35b9-4df2-9417-4ecf2e7d519e will not be triggered until provisioned by entity DHCP. {{(pid=93836) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:51.973472 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:52.019196 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Pushing event updated for resources: {'Port': ['ID=51fab0de-35b9-4df2-9417-4ecf2e7d519e,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:52.036117 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Network 5b6358fd-941d-4575-bad3-2592e08ee13f is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:00:52.042289 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:00:52.045050 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:00:52.062097 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] Set router eaed026e-b8b6-438b-8d43-76d2afcb1335 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:00:52.138201 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1827972'] for router_interface, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:52.214315 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:52.301458 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:52.321806 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:52.327745 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:52.328436 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:52.366671 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d98b2f9-7b6e-4ca6-a3da-367681056e3b None None] Network 5b6358fd-941d-4575-bad3-2592e08ee13f requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:00:52.436151 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'name': 'tempest-TestVolumeBootPattern-847636729-router', 'tenant_id': '45595a19a07042cda8672bd206162373', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.177'}], 'enable_snat': True}, 'gw_port_id': '755518de-49ad-448d-91ea-944a89f41331', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:48Z', 'updated_at': '2021-09-01T17:00:50Z', 'revision_number': 3, 'project_id': '45595a19a07042cda8672bd206162373', 'gw_port': {'id': '755518de-49ad-448d-91ea-944a89f41331', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:e2:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'device_owner': 'network:router_gateway', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:49Z', 'updated_at': '2021-09-01T17:00:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:52.464518 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:52.473301 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a1bc1b1-d687-455d-818c-59c67d4b5893 None None] The sync data for ids ['eaed026e-b8b6-438b-8d43-76d2afcb1335'] in dv-cinder-799668-16-iscsi is: [{'id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'name': 'tempest-TestVolumeBootPattern-847636729-router', 'tenant_id': '45595a19a07042cda8672bd206162373', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.177'}], 'enable_snat': True}, 'gw_port_id': '755518de-49ad-448d-91ea-944a89f41331', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:48Z', 'updated_at': '2021-09-01T17:00:50Z', 'revision_number': 3, 'project_id': '45595a19a07042cda8672bd206162373', 'gw_port': {'id': '755518de-49ad-448d-91ea-944a89f41331', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:e2:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'device_owner': 'network:router_gateway', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:49Z', 'updated_at': '2021-09-01T17:00:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:00:52.535997 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-c2893f7b-4cdd-4a0b-836a-868553611297 None None] Provisioning for port 2428f97b-7581-4636-8957-db3a5330a720 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:52.606706 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Notify callbacks [] for port, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:52.620438 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55866c2e-9c46-4651-8533-12b525911186 req-3fa2dc25-6a64-4b4a-b5f4-66cc9c5592f9 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:52.622063 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-55866c2e-9c46-4651-8533-12b525911186 req-3fa2dc25-6a64-4b4a-b5f4-66cc9c5592f9 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 949 time: 0.0932033 Sep 01 17:00:52.623226 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6279726'] for port, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:52.643885 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:52.688119 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:52.696682 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:52.697411 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:52.703631 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0239f1a0-a747-468c-b1c3-baae21f2e1ae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:00:52.705942 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8bff0219-ec14-4b91-8085-7fdd2b3cdc9a" -d '{"events": [{"server_uuid": "0239f1a0-a747-468c-b1c3-baae21f2e1ae", "name": "network-vif-plugged", "status": "completed", "tag": "7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:00:52.720421 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611336', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1832500'] for router_interface, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:52.729407 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Pushing event updated for resources: {'Port': ['ID=51fab0de-35b9-4df2-9417-4ecf2e7d519e,revision_number=2']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:52.747420 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:52.750172 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-55866c2e-9c46-4651-8533-12b525911186 req-84904b8c-4dcd-40ed-9d03-26cdbd36a778 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0941610 Sep 01 17:00:52.778585 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:52.778585 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:52.831322 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:00:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f0f511d4-88ec-4995-a93c-3ef7b5efd3cd x-openstack-request-id: req-f0f511d4-88ec-4995-a93c-3ef7b5efd3cd {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:00:52.831721 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0239f1a0-a747-468c-b1c3-baae21f2e1ae", "name": "network-vif-plugged", "status": "completed", "tag": "7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:00:52.832038 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-f0f511d4-88ec-4995-a93c-3ef7b5efd3cd {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:00:52.832489 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0239f1a0-a747-468c-b1c3-baae21f2e1ae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc', 'code': 200} Sep 01 17:00:52.892457 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:52.903279 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Network 5b6358fd-941d-4575-bad3-2592e08ee13f is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:00:52.905062 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:00:52.948026 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:52.954644 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:52.955085 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:52.957080 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:53.032252 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:53.041430 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:53.052654 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 2428f97b-7581-4636-8957-db3a5330a720 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:53.056392 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9b4dcd6-1fab-4884-bda3-bc10c0cf5fb2 req-1414bae4-4f12-47b7-a6d4-f6458cfad513 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:53.060382 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f9b4dcd6-1fab-4884-bda3-bc10c0cf5fb2 req-1414bae4-4f12-47b7-a6d4-f6458cfad513 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 1098 time: 0.0796094 Sep 01 17:00:53.126534 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f9b4dcd6-1fab-4884-bda3-bc10c0cf5fb2 req-566f9630-7112-4bd8-8b7d-599162dc55ec service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498316 Sep 01 17:00:53.182601 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eed16c6-595d-4707-8c26-afb42706f7a1 req-dd16a4f3-a339-4471-9cd0-fb31fb7d846d tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:53.191177 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4eed16c6-595d-4707-8c26-afb42706f7a1 req-dd16a4f3-a339-4471-9cd0-fb31fb7d846d tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 945 time: 0.2278574 Sep 01 17:00:53.213505 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:53.221844 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba6f9796-502d-46a4-8790-2c2bdd20fdee req-6abda63a-0a4b-4830-b0bd-d69552dc8cc1 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:53.222057 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:53.231694 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ba6f9796-502d-46a4-8790-2c2bdd20fdee req-6abda63a-0a4b-4830-b0bd-d69552dc8cc1 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.3087397 Sep 01 17:00:53.246439 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 2428f97b-7581-4636-8957-db3a5330a720 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:53.263944 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 2428f97b-7581-4636-8957-db3a5330a720 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:53.264319 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:53.270446 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9,segment=NetworkSegment(158e4a10-7bf0-4070-aeaf-6bca65a0cfb8),segment_id=158e4a10-7bf0-4070-aeaf-6bca65a0cfb8)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:53.338275 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ba6f9796-502d-46a4-8790-2c2bdd20fdee req-4088efe9-6cba-489f-bcca-f2c89be4b1d7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1029894 Sep 01 17:00:53.345380 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:53.354587 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Router eaed026e-b8b6-438b-8d43-76d2afcb1335 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:00:53.359149 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4eed16c6-595d-4707-8c26-afb42706f7a1 req-c7b922a6-73d8-4b20-abd1-8451ad4aa348 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1671243 Sep 01 17:00:53.484687 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:53.488209 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:53.499521 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-530e256b-c01f-4d84-b4eb-fd8a6c91efd6 None None] Provisioning for port 51fab0de-35b9-4df2-9417-4ecf2e7d519e completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:53.521643 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-530e256b-c01f-4d84-b4eb-fd8a6c91efd6 None None] Provisioning complete for port 51fab0de-35b9-4df2-9417-4ecf2e7d519e triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:53.522021 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-530e256b-c01f-4d84-b4eb-fd8a6c91efd6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:53.596509 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port 2428f97b-7581-4636-8957-db3a5330a720, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=2428f97b-7581-4636-8957-db3a5330a720,segment=NetworkSegment(b29f5104-3b2d-4e40-af30-f0607bf9318e),segment_id=b29f5104-3b2d-4e40-af30-f0607bf9318e)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:53.605915 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-530e256b-c01f-4d84-b4eb-fd8a6c91efd6 None None] Port 51fab0de-35b9-4df2-9417-4ecf2e7d519e cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:00:53.608898 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:53.612574 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:00:53.627998 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-ac272527-f1c3-4d58-9194-50da99ebc1a2 admin admin] 10.222.0.67 "PUT /v2.0/routers/eaed026e-b8b6-438b-8d43-76d2afcb1335/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7989500 Sep 01 17:00:53.670921 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-530e256b-c01f-4d84-b4eb-fd8a6c91efd6 None None] Provisioning complete for port 2428f97b-7581-4636-8957-db3a5330a720 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:53.670921 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-530e256b-c01f-4d84-b4eb-fd8a6c91efd6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:53.796801 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:53.802695 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=2428f97b-7581-4636-8957-db3a5330a720,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:53.875977 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-03b22ae4-5d9c-4524-b18f-524bf85499b9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:53.947507 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18edeba-e7e3-432c-9d06-7c09d8275db1 req-525c8597-7187-45be-b682-886a820355ec tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:53.949078 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c18edeba-e7e3-432c-9d06-7c09d8275db1 req-525c8597-7187-45be-b682-886a820355ec tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 950 time: 0.0818124 Sep 01 17:00:54.000891 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-6a397b3c-bf73-4974-b1bb-b0c478181365 None None] Provisioning complete for port 51fab0de-35b9-4df2-9417-4ecf2e7d519e triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:54.001607 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-6a397b3c-bf73-4974-b1bb-b0c478181365 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:54.007680 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c18edeba-e7e3-432c-9d06-7c09d8275db1 req-db4357b9-945e-4669-9ae2-aee1dec4dd38 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434775 Sep 01 17:00:54.047804 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-6a397b3c-bf73-4974-b1bb-b0c478181365 None None] Port 51fab0de-35b9-4df2-9417-4ecf2e7d519e cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:00:54.482370 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 755518de-49ad-448d-91ea-944a89f41331 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:54.503530 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cef89b-5fbf-4bd6-bd96-6060c14783dc req-403ad83a-d9b7-4677-8c00-860e9cc6e299 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:54.505147 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-99cef89b-5fbf-4bd6-bd96-6060c14783dc req-403ad83a-d9b7-4677-8c00-860e9cc6e299 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0839019 Sep 01 17:00:54.548222 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 55538) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:54.555526 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-601dd715-1342-4cd1-94f2-7edb945bc227 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1200574755', 'description': 'tempest-secgroup-smoke-1200574755 description', 'project_id': '63c213b6da7541a0ba2b290c5e15fe03'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:54.558015 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 755518de-49ad-448d-91ea-944a89f41331 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:54.564428 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 755518de-49ad-448d-91ea-944a89f41331 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:54.564887 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:54.578646 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-99cef89b-5fbf-4bd6-bd96-6060c14783dc req-8fdec0bb-401e-43a4-8fd1-19edc26fce25 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0615184 Sep 01 17:00:54.619331 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-601dd715-1342-4cd1-94f2-7edb945bc227 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:54.761882 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecc550b2-fa45-49a4-bdce-aefe6c76b5b2 req-7780e3d5-88df-4e4c-b79c-6eb33b8364be tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:54.774650 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ecc550b2-fa45-49a4-bdce-aefe6c76b5b2 req-7780e3d5-88df-4e4c-b79c-6eb33b8364be tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 945 time: 0.1251826 Sep 01 17:00:54.840877 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '05e4c24b-2664-4883-bc91-fbef674b70b4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:00:54.844025 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-161a713a-784a-4144-bcfb-cea25b3835ad" -d '{"events": [{"server_uuid": "05e4c24b-2664-4883-bc91-fbef674b70b4", "name": "network-vif-plugged", "status": "completed", "tag": "1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:00:54.857113 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ecc550b2-fa45-49a4-bdce-aefe6c76b5b2 req-5631ff02-56a8-4e32-8a42-a6d04c57caa9 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759854 Sep 01 17:00:54.869587 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:54.885505 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-601dd715-1342-4cd1-94f2-7edb945bc227 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:54.890289 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-601dd715-1342-4cd1-94f2-7edb945bc227 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:54.907533 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:00:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-22a629ca-a405-4112-bda8-eb25e6a38a4b x-openstack-request-id: req-22a629ca-a405-4112-bda8-eb25e6a38a4b {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:00:54.907981 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "05e4c24b-2664-4883-bc91-fbef674b70b4", "name": "network-vif-plugged", "status": "completed", "tag": "1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:00:54.908239 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-22a629ca-a405-4112-bda8-eb25e6a38a4b {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:00:54.908632 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '05e4c24b-2664-4883-bc91-fbef674b70b4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9', 'code': 200} Sep 01 17:00:54.917822 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port 755518de-49ad-448d-91ea-944a89f41331, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=755518de-49ad-448d-91ea-944a89f41331,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:54.919493 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:54.921943 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:54.922982 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:54.924213 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-601dd715-1342-4cd1-94f2-7edb945bc227 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8ded1df8-6989-4db0-876f-79e2a5cfe05e,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:54.928018 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-601dd715-1342-4cd1-94f2-7edb945bc227 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:54.930001 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-601dd715-1342-4cd1-94f2-7edb945bc227 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.3802769 Sep 01 17:00:54.933511 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 55544) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:54.942147 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-4b94fb14-4653-4413-be3b-dcf07f2a8177 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Request body: {'security_group_rule': {'security_group_id': '8ded1df8-6989-4db0-876f-79e2a5cfe05e', 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:54.986940 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Sync routers for ids ['eaed026e-b8b6-438b-8d43-76d2afcb1335'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:00:54.987306 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4b94fb14-4653-4413-be3b-dcf07f2a8177 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.021279 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Routers {'eaed026e-b8b6-438b-8d43-76d2afcb1335'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:00:55.021904 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:00:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['eaed026e-b8b6-438b-8d43-76d2afcb1335'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:55.025424 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=755518de-49ad-448d-91ea-944a89f41331,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:55.087252 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4b94fb14-4653-4413-be3b-dcf07f2a8177 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.094064 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4b94fb14-4653-4413-be3b-dcf07f2a8177 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.101900 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:55.102290 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.146554 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4b94fb14-4653-4413-be3b-dcf07f2a8177 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.151169 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-4b94fb14-4653-4413-be3b-dcf07f2a8177 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2099724 Sep 01 17:00:55.151169 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b94fb14-4653-4413-be3b-dcf07f2a8177 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9582c536-5ca8-4a71-a302-687e7d9f7c0a,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:55.151808 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 55548) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:55.168330 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-4311abe2-d206-4655-926a-badc92e81c71 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Request body: {'security_group_rule': {'security_group_id': '8ded1df8-6989-4db0-876f-79e2a5cfe05e', 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:55.175997 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3323056c-a9ae-4aa6-ac23-43f9f2484f13 req-26ff83b4-3c9c-4128-8ac9-39813518afad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:55.177691 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3323056c-a9ae-4aa6-ac23-43f9f2484f13 req-26ff83b4-3c9c-4128-8ac9-39813518afad service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 1103 time: 0.0547290 Sep 01 17:00:55.190912 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Set router eaed026e-b8b6-438b-8d43-76d2afcb1335 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:00:55.220379 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3323056c-a9ae-4aa6-ac23-43f9f2484f13 req-a26db91a-380b-4b36-a9af-7a6a0fa9f736 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0333173 Sep 01 17:00:55.229932 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c83588e2-94d0-4d55-928d-8a37b8bd9537 req-d1756629-7643-497b-8645-3c9a1c1ffe6f tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:55.231735 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c83588e2-94d0-4d55-928d-8a37b8bd9537 req-d1756629-7643-497b-8645-3c9a1c1ffe6f tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 950 time: 0.0873702 Sep 01 17:00:55.244383 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4311abe2-d206-4655-926a-badc92e81c71 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.297528 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c83588e2-94d0-4d55-928d-8a37b8bd9537 req-567970dd-a50f-4a63-9463-ab321c0586c1 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593967 Sep 01 17:00:55.319076 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4311abe2-d206-4655-926a-badc92e81c71 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.323396 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4311abe2-d206-4655-926a-badc92e81c71 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.343167 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4311abe2-d206-4655-926a-badc92e81c71 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=985b3530-9528-4c6e-a166-1a29d37df9c0,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:55.344006 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 2428f97b-7581-4636-8957-db3a5330a720 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:55.351092 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4311abe2-d206-4655-926a-badc92e81c71 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.352476 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-4311abe2-d206-4655-926a-badc92e81c71 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1905570 Sep 01 17:00:55.355245 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 55552) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:55.359721 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-ede08cc6-e7af-41af-affd-cffad9556f1e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Request body: {'security_group_rule': {'security_group_id': '8ded1df8-6989-4db0-876f-79e2a5cfe05e', 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:55.390175 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ede08cc6-e7af-41af-affd-cffad9556f1e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.454577 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ede08cc6-e7af-41af-affd-cffad9556f1e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.458485 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 2428f97b-7581-4636-8957-db3a5330a720 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:55.458916 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.460857 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ede08cc6-e7af-41af-affd-cffad9556f1e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.476720 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ede08cc6-e7af-41af-affd-cffad9556f1e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b7cdce97-9dcc-4a59-9e29-8d8da529d551,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:55.487541 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ede08cc6-e7af-41af-affd-cffad9556f1e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.488846 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-ede08cc6-e7af-41af-affd-cffad9556f1e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1325865 Sep 01 17:00:55.492092 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 55558) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:55.496205 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-ea2240c5-a88c-4443-a999-eafbe9d03d96 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Request body: {'security_group_rule': {'security_group_id': '8ded1df8-6989-4db0-876f-79e2a5cfe05e', 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:55.511098 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'name': 'tempest-TestVolumeBootPattern-847636729-router', 'tenant_id': '45595a19a07042cda8672bd206162373', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.177'}], 'enable_snat': True}, 'gw_port_id': '755518de-49ad-448d-91ea-944a89f41331', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:48Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 4, 'project_id': '45595a19a07042cda8672bd206162373', 'gw_port': {'id': '755518de-49ad-448d-91ea-944a89f41331', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:e2:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'device_owner': 'network:router_gateway', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:49Z', 'updated_at': '2021-09-01T17:00:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '51fab0de-35b9-4df2-9417-4ecf2e7d519e', 'name': '', 'network_id': '5b6358fd-941d-4575-bad3-2592e08ee13f', 'tenant_id': '45595a19a07042cda8672bd206162373', 'mac_address': 'fa:16:3e:20:08:bd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'device_owner': 'network:router_interface', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '83cfc7d8-6589-4159-a8f7-3faa0a2f904f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:51Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 2, 'project_id': '45595a19a07042cda8672bd206162373', 'subnets': [{'id': '83cfc7d8-6589-4159-a8f7-3faa0a2f904f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:55.525079 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ea2240c5-a88c-4443-a999-eafbe9d03d96 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.540937 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Checking router: eaed026e-b8b6-438b-8d43-76d2afcb1335 for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:00:55.541215 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Updating router eaed026e-b8b6-438b-8d43-76d2afcb1335 port 51fab0de-35b9-4df2-9417-4ecf2e7d519e binding host dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 17:00:55.591067 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ea2240c5-a88c-4443-a999-eafbe9d03d96 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.594798 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.596215 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ea2240c5-a88c-4443-a999-eafbe9d03d96 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.614825 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea2240c5-a88c-4443-a999-eafbe9d03d96 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=acc25ed6-e8b0-4ef5-bc0f-c93ef5822fc9,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:55.631242 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ea2240c5-a88c-4443-a999-eafbe9d03d96 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.636225 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-ea2240c5-a88c-4443-a999-eafbe9d03d96 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1435194 Sep 01 17:00:55.636418 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 55564) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:55.640992 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-80af15e6-9f09-4582-a1fa-dc247f2eda49 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Request body: {'security_group_rule': {'security_group_id': '8ded1df8-6989-4db0-876f-79e2a5cfe05e', 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:55.687240 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.securitygroups_db [None req-80af15e6-9f09-4582-a1fa-dc247f2eda49 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Project 63c213b6da7541a0ba2b290c5e15fe03 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 01 17:00:55.693853 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-80af15e6-9f09-4582-a1fa-dc247f2eda49 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.732842 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dc53e15-46f0-48e8-98af-0a793a32ab31 req-8c7ee611-d087-4ec4-abff-be18e0b0431d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:55.739817 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3dc53e15-46f0-48e8-98af-0a793a32ab31 req-8c7ee611-d087-4ec4-abff-be18e0b0431d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0693874 Sep 01 17:00:55.818486 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3dc53e15-46f0-48e8-98af-0a793a32ab31 req-c109770c-5e16-4ccd-8eef-f86dbeb9feb7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0722032 Sep 01 17:00:55.861967 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d178d0b-b8c2-4251-8e15-48c54008470d req-7219409c-7e72-43f1-a0f8-3770f231234e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:55.874243 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0d178d0b-b8c2-4251-8e15-48c54008470d req-7219409c-7e72-43f1-a0f8-3770f231234e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0919871 Sep 01 17:00:55.937988 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0d178d0b-b8c2-4251-8e15-48c54008470d req-2159662e-09c3-40d2-ba9f-4ab9ef77797f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0639579 Sep 01 17:00:55.984626 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Notify callbacks [] for port, precommit_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:55.996039 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Transition to ACTIVE for port object 51fab0de-35b9-4df2-9417-4ecf2e7d519e will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:00:56.004407 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:56.005698 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-80af15e6-9f09-4582-a1fa-dc247f2eda49 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:56.012031 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-80af15e6-9f09-4582-a1fa-dc247f2eda49 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:56.033461 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60975c2c-1586-4b42-948e-0a1f68e864cf req-d1104c62-20de-4691-b9c3-0f9834719ca1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:56.035032 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60975c2c-1586-4b42-948e-0a1f68e864cf req-d1104c62-20de-4691-b9c3-0f9834719ca1 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=4199ca0b18374af7856c19238fc2fea1&device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 1098 time: 0.0887737 Sep 01 17:00:56.038713 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80af15e6-9f09-4582-a1fa-dc247f2eda49 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ce299a32-bb43-42f6-9580-65b532fdeb5d,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:56.055508 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-80af15e6-9f09-4582-a1fa-dc247f2eda49 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:56.058200 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-80af15e6-9f09-4582-a1fa-dc247f2eda49 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4208348 Sep 01 17:00:56.060406 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 55572) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:00:56.066857 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-5bd3bee8-2474-40d7-b4a4-1b1d53260b8f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Request body: {'security_group_rule': {'security_group_id': '8ded1df8-6989-4db0-876f-79e2a5cfe05e', 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:00:56.087480 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79da069a-f8c0-4922-aa8e-9f49aede8148 None None] Pushing event updated for resources: {'Port': ['ID=51fab0de-35b9-4df2-9417-4ecf2e7d519e,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:56.122198 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Attempting to bind port 51fab0de-35b9-4df2-9417-4ecf2e7d519e on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:00:56.122561 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Attempting to bind port 51fab0de-35b9-4df2-9417-4ecf2e7d519e by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': 'b29f5104-3b2d-4e40-af30-f0607bf9318e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '5b6358fd-941d-4575-bad3-2592e08ee13f'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:00:56.122926 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Attempting to bind port 51fab0de-35b9-4df2-9417-4ecf2e7d519e on network 5b6358fd-941d-4575-bad3-2592e08ee13f {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:00:56.128931 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 0, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:00:56.129486 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Checking segment: {'id': 'b29f5104-3b2d-4e40-af30-f0607bf9318e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '5b6358fd-941d-4575-bad3-2592e08ee13f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:00:56.129894 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:56.130336 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Bound using segment: {'id': 'b29f5104-3b2d-4e40-af30-f0607bf9318e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '5b6358fd-941d-4575-bad3-2592e08ee13f'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:00:56.130812 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Bound port: 51fab0de-35b9-4df2-9417-4ecf2e7d519e, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b29f5104-3b2d-4e40-af30-f0607bf9318e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '5b6358fd-941d-4575-bad3-2592e08ee13f'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:00:56.131187 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:56.134018 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.securitygroups_db [None req-5bd3bee8-2474-40d7-b4a4-1b1d53260b8f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Project 63c213b6da7541a0ba2b290c5e15fe03 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 01 17:00:56.141736 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5bd3bee8-2474-40d7-b4a4-1b1d53260b8f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:56.232942 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] For port 51fab0de-35b9-4df2-9417-4ecf2e7d519e, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:00:56.237843 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] For port 51fab0de-35b9-4df2-9417-4ecf2e7d519e, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=51fab0de-35b9-4df2-9417-4ecf2e7d519e,segment=NetworkSegment(b29f5104-3b2d-4e40-af30-f0607bf9318e),segment_id=b29f5104-3b2d-4e40-af30-f0607bf9318e)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:00:56.245131 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60975c2c-1586-4b42-948e-0a1f68e864cf req-0d5fad18-7227-46b4-8dd0-4f177e18dd46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:56.247447 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60975c2c-1586-4b42-948e-0a1f68e864cf req-0d5fad18-7227-46b4-8dd0-4f177e18dd46 service neutron] 10.222.0.69 "GET /v2.0/networks?id=63606bb0-66bd-46d6-ba6c-55c6da830865 HTTP/1.1" status: 200 len: 920 time: 0.2011571 Sep 01 17:00:56.247834 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f232d12-c870-4c1c-b52c-d02c539b5fea req-96160009-589e-4a4f-973a-02a12592c32a tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:56.249231 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:56.249639 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2f232d12-c870-4c1c-b52c-d02c539b5fea req-96160009-589e-4a4f-973a-02a12592c32a tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 945 time: 0.2947421 Sep 01 17:00:56.306340 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60975c2c-1586-4b42-948e-0a1f68e864cf req-e21f18c2-8635-4130-b78d-cbbb7dd35a75 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e3d13334-c7d0-4f40-a25b-5c27c5f90c65 HTTP/1.1" status: 200 len: 217 time: 0.0437410 Sep 01 17:00:56.308035 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5bd3bee8-2474-40d7-b4a4-1b1d53260b8f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:56.313330 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5bd3bee8-2474-40d7-b4a4-1b1d53260b8f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:56.335877 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2f232d12-c870-4c1c-b52c-d02c539b5fea req-02628da6-3640-4458-9191-6f93f1067026 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753534 Sep 01 17:00:56.363700 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Routers {'eaed026e-b8b6-438b-8d43-76d2afcb1335'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:00:56.366099 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:00:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['eaed026e-b8b6-438b-8d43-76d2afcb1335'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:56.372843 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bd3bee8-2474-40d7-b4a4-1b1d53260b8f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c842bf25-7b39-41d0-b3c2-ade4c42a33e0,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:56.393539 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5bd3bee8-2474-40d7-b4a4-1b1d53260b8f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:56.395828 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-5bd3bee8-2474-40d7-b4a4-1b1d53260b8f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3342428 Sep 01 17:00:56.412290 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60975c2c-1586-4b42-948e-0a1f68e864cf req-f6c9277c-657d-4664-a240-118a6b416445 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:56.414222 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60975c2c-1586-4b42-948e-0a1f68e864cf req-f6c9277c-657d-4664-a240-118a6b416445 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd331d5b-40b1-4163-8537-7af4e56f1efd HTTP/1.1" status: 200 len: 859 time: 0.0829480 Sep 01 17:00:56.459822 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60975c2c-1586-4b42-948e-0a1f68e864cf req-6ed8e017-0eb6-42a2-87e4-539780fb3af8 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=63606bb0-66bd-46d6-ba6c-55c6da830865&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0343442 Sep 01 17:00:56.518762 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79da069a-f8c0-4922-aa8e-9f49aede8148 None None] Pushing event updated for resources: {'Port': ['ID=51fab0de-35b9-4df2-9417-4ecf2e7d519e,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:56.530521 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 755518de-49ad-448d-91ea-944a89f41331 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:56.533721 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c6f893-b197-4221-8cf4-4727ea45a1a9 req-5ec070c8-e0e0-4e76-9657-1f374e80c0fa tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:56.550293 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d4c6f893-b197-4221-8cf4-4727ea45a1a9 req-5ec070c8-e0e0-4e76-9657-1f374e80c0fa tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 950 time: 0.1084692 Sep 01 17:00:56.593433 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:00:56.603017 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:56.613227 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60975c2c-1586-4b42-948e-0a1f68e864cf req-63a7a701-3206-4e8b-a32f-85e0da5792fb service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1435547 Sep 01 17:00:56.630532 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d4c6f893-b197-4221-8cf4-4727ea45a1a9 req-4ff9ccbb-5b0e-4f4f-8ab7-3910ca5146d8 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0792940 Sep 01 17:00:56.635582 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:56.642083 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] Set router eaed026e-b8b6-438b-8d43-76d2afcb1335 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:00:56.695538 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 755518de-49ad-448d-91ea-944a89f41331 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:56.696075 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:56.806400 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60975c2c-1586-4b42-948e-0a1f68e864cf req-1b76d256-2995-4626-a558-46839120bc9d service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1737540 Sep 01 17:00:57.034860 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6cc557b-0c86-43ae-b41d-a8d0383d159b req-9ee0e20b-f6fd-46b5-8ee2-77e8c86f2017 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:57.055560 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d6cc557b-0c86-43ae-b41d-a8d0383d159b req-9ee0e20b-f6fd-46b5-8ee2-77e8c86f2017 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.1071045 Sep 01 17:00:57.118275 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'name': 'tempest-TestVolumeBootPattern-847636729-router', 'tenant_id': '45595a19a07042cda8672bd206162373', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.177'}], 'enable_snat': True}, 'gw_port_id': '755518de-49ad-448d-91ea-944a89f41331', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:48Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 4, 'project_id': '45595a19a07042cda8672bd206162373', 'gw_port': {'id': '755518de-49ad-448d-91ea-944a89f41331', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:e2:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'device_owner': 'network:router_gateway', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:49Z', 'updated_at': '2021-09-01T17:00:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '51fab0de-35b9-4df2-9417-4ecf2e7d519e', 'name': '', 'network_id': '5b6358fd-941d-4575-bad3-2592e08ee13f', 'tenant_id': '45595a19a07042cda8672bd206162373', 'mac_address': 'fa:16:3e:20:08:bd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'device_owner': 'network:router_interface', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '83cfc7d8-6589-4159-a8f7-3faa0a2f904f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:51Z', 'updated_at': '2021-09-01T17:00:56Z', 'revision_number': 4, 'project_id': '45595a19a07042cda8672bd206162373', 'subnets': [{'id': '83cfc7d8-6589-4159-a8f7-3faa0a2f904f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:00:57.148341 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61bc91da-4c52-4cec-bccb-07a346e85a77 None None] The sync data for ids ['eaed026e-b8b6-438b-8d43-76d2afcb1335'] in dv-cinder-799668-16-iscsi is: [{'id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'name': 'tempest-TestVolumeBootPattern-847636729-router', 'tenant_id': '45595a19a07042cda8672bd206162373', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.177'}], 'enable_snat': True}, 'gw_port_id': '755518de-49ad-448d-91ea-944a89f41331', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:48Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 4, 'project_id': '45595a19a07042cda8672bd206162373', 'gw_port': {'id': '755518de-49ad-448d-91ea-944a89f41331', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:e2:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'device_owner': 'network:router_gateway', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:49Z', 'updated_at': '2021-09-01T17:00:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '51fab0de-35b9-4df2-9417-4ecf2e7d519e', 'name': '', 'network_id': '5b6358fd-941d-4575-bad3-2592e08ee13f', 'tenant_id': '45595a19a07042cda8672bd206162373', 'mac_address': 'fa:16:3e:20:08:bd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'device_owner': 'network:router_interface', 'standard_attr_id': 445, 'fixed_ips': [{'subnet_id': '83cfc7d8-6589-4159-a8f7-3faa0a2f904f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:51Z', 'updated_at': '2021-09-01T17:00:56Z', 'revision_number': 4, 'project_id': '45595a19a07042cda8672bd206162373', 'subnets': [{'id': '83cfc7d8-6589-4159-a8f7-3faa0a2f904f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:00:57.154441 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d6cc557b-0c86-43ae-b41d-a8d0383d159b req-d164c44c-35a2-4667-b113-b973cdb12359 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0964708 Sep 01 17:00:57.169498 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf7cf69a-3ba7-4547-86b9-fa954683a7ad req-9188add1-8e67-482a-8f06-b1dc230dec04 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:57.179759 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cf7cf69a-3ba7-4547-86b9-fa954683a7ad req-9188add1-8e67-482a-8f06-b1dc230dec04 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.1078296 Sep 01 17:00:57.252843 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cf7cf69a-3ba7-4547-86b9-fa954683a7ad req-34ab0863-ec09-4aac-964f-92c17827f41f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721200 Sep 01 17:00:57.779655 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514676db-caf5-4365-9052-8ba4fd4cb0f4 req-6d50d14f-cf2d-4356-b813-17dd7b044dad tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:57.781320 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-514676db-caf5-4365-9052-8ba4fd4cb0f4 req-6d50d14f-cf2d-4356-b813-17dd7b044dad tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 950 time: 0.0525205 Sep 01 17:00:57.824122 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-514676db-caf5-4365-9052-8ba4fd4cb0f4 req-1c8695df-499a-4181-ae6f-e492f5d32460 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366974 Sep 01 17:00:58.129973 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e05c347c-347c-4eef-a9e9-787a77585f6e req-cf497835-5c43-4f27-a181-2c73148979e7 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:58.131561 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e05c347c-347c-4eef-a9e9-787a77585f6e req-cf497835-5c43-4f27-a181-2c73148979e7 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 950 time: 0.0621374 Sep 01 17:00:58.171319 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e05c347c-347c-4eef-a9e9-787a77585f6e req-37e6954e-993d-45f9-a65f-b5c42b21bf6e tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322988 Sep 01 17:00:58.216886 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device f3cd3382-a1bb-4f12-b1b1-64bd000296fb details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:00:58.315212 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f47ff172-3bbf-4533-a9e7-230a305618a2 req-ebe18b07-c4ab-4915-920b-17327fc13636 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:58.330306 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f47ff172-3bbf-4533-a9e7-230a305618a2 req-ebe18b07-c4ab-4915-920b-17327fc13636 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0803888 Sep 01 17:00:58.368337 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port f3cd3382-a1bb-4f12-b1b1-64bd000296fb, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:58.394815 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f47ff172-3bbf-4533-a9e7-230a305618a2 req-33aa4a29-2e2d-4ade-a227-ffeae6365edf tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0558977 Sep 01 17:00:58.417947 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'port_id': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'mac_address': 'fa:16:3e:95:9e:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 544, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:00:58.457873 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 51fab0de-35b9-4df2-9417-4ecf2e7d519e up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:00:58.517481 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc782453-4442-4446-b468-4a0830a80e9a req-93d539f9-b96e-4fa0-b637-e30b06dde6ca tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:58.519302 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cc782453-4442-4446-b468-4a0830a80e9a req-93d539f9-b96e-4fa0-b637-e30b06dde6ca tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0616102 Sep 01 17:00:58.530844 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:58.551562 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id f3cd3382-a1bb-4f12-b1b1-64bd000296fb {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:00:58.572292 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 51fab0de-35b9-4df2-9417-4ecf2e7d519e completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:00:58.578348 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port f3cd3382-a1bb-4f12-b1b1-64bd000296fb, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:58.580268 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 51fab0de-35b9-4df2-9417-4ecf2e7d519e triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:00:58.580692 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:58.581681 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cc782453-4442-4446-b468-4a0830a80e9a req-5d626d47-96e9-4614-90b4-da802abcb123 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447605 Sep 01 17:00:58.582874 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:58.675943 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,revision_number=6']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:58.723336 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:58.758864 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port 51fab0de-35b9-4df2-9417-4ecf2e7d519e, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=51fab0de-35b9-4df2-9417-4ecf2e7d519e,segment=NetworkSegment(b29f5104-3b2d-4e40-af30-f0607bf9318e),segment_id=b29f5104-3b2d-4e40-af30-f0607bf9318e)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:00:58.763064 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:00:58.768780 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['f3cd3382-a1bb-4f12-b1b1-64bd000296fb'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:00:58.846192 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=51fab0de-35b9-4df2-9417-4ecf2e7d519e,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:00:59.304298 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0563511-19f3-49d2-924f-ac700ac57230 req-f7ebbfbd-4d42-410f-be5d-e485aac1af39 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:59.305831 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d0563511-19f3-49d2-924f-ac700ac57230 req-f7ebbfbd-4d42-410f-be5d-e485aac1af39 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 950 time: 0.0495758 Sep 01 17:00:59.352887 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d0563511-19f3-49d2-924f-ac700ac57230 req-d88c4e1c-afe8-41d6-ab95-d3ca1af00f85 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396035 Sep 01 17:00:59.552762 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a748cca-e9ee-468b-a98b-782d69d97066 req-97c3e941-f75b-4a67-a76e-0ad2a05507aa tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:59.555253 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7a748cca-e9ee-468b-a98b-782d69d97066 req-97c3e941-f75b-4a67-a76e-0ad2a05507aa tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 944 time: 0.0768094 Sep 01 17:00:59.596089 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7a748cca-e9ee-468b-a98b-782d69d97066 req-478d4ba9-5644-49ca-a0cb-7770dcabecba tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0347290 Sep 01 17:00:59.726870 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73657bcb-bc08-4d80-bf64-05a2bacd5e0e req-00bb8a36-5b35-4195-842a-d060ba4e45fb tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:00:59.728509 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-73657bcb-bc08-4d80-bf64-05a2bacd5e0e req-00bb8a36-5b35-4195-842a-d060ba4e45fb tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0578816 Sep 01 17:00:59.782020 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-73657bcb-bc08-4d80-bf64-05a2bacd5e0e req-32413a0c-f289-4ec7-9221-829187b7b572 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449061 Sep 01 17:01:00.235012 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device f3cd3382-a1bb-4f12-b1b1-64bd000296fb up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:01:00.304957 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port f3cd3382-a1bb-4f12-b1b1-64bd000296fb triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:01:00.305403 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:00.389914 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-459a3121-1702-4a8d-9560-ce45fc4ce01f req-64bd7f63-944f-4bf4-9708-462697a5a7cb tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:00.392220 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-459a3121-1702-4a8d-9560-ce45fc4ce01f req-64bd7f63-944f-4bf4-9708-462697a5a7cb tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.69 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 950 time: 0.0826797 Sep 01 17:01:00.404989 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 51fab0de-35b9-4df2-9417-4ecf2e7d519e up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:01:00.468474 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:00.507001 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53cb072c-ebbe-4074-abae-5f8f29fe2800 req-870f686a-a6b7-4e70-a141-a7ae059c5835 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:00.516927 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-53cb072c-ebbe-4074-abae-5f8f29fe2800 req-870f686a-a6b7-4e70-a141-a7ae059c5835 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 950 time: 0.0691521 Sep 01 17:01:00.556864 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:00.567050 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e3ffced6-73fb-4981-9ab1-8fe00a919961" -d '{"events": [{"server_uuid": "0678fbe1-e92f-49b6-93cd-5babcfc2de18", "name": "network-vif-plugged", "status": "completed", "tag": "f3cd3382-a1bb-4f12-b1b1-64bd000296fb"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:00.576610 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-459a3121-1702-4a8d-9560-ce45fc4ce01f req-ba38fd8e-89c9-4166-826f-a5f6ccbe2cbe tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Deleting port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:01:00.577249 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-459a3121-1702-4a8d-9560-ce45fc4ce01f req-ba38fd8e-89c9-4166-826f-a5f6ccbe2cbe tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:00.584214 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-53cb072c-ebbe-4074-abae-5f8f29fe2800 req-c079721d-83e6-4682-9fcf-a98d7a9e3e81 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/security-groups?id=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646369 Sep 01 17:01:00.602281 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port f3cd3382-a1bb-4f12-b1b1-64bd000296fb, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:00.612882 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:00.635262 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 51fab0de-35b9-4df2-9417-4ecf2e7d519e triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:01:00.637036 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:00.666193 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b6820168-cf25-40ba-9321-6128bf60973f x-openstack-request-id: req-b6820168-cf25-40ba-9321-6128bf60973f {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:00.666474 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0678fbe1-e92f-49b6-93cd-5babcfc2de18", "name": "network-vif-plugged", "status": "completed", "tag": "f3cd3382-a1bb-4f12-b1b1-64bd000296fb", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:00.666722 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-b6820168-cf25-40ba-9321-6128bf60973f {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:00.667107 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'code': 200} Sep 01 17:01:00.739623 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-459a3121-1702-4a8d-9560-ce45fc4ce01f req-ba38fd8e-89c9-4166-826f-a5f6ccbe2cbe tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] For port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9,segment=NetworkSegment(158e4a10-7bf0-4070-aeaf-6bca65a0cfb8),segment_id=158e4a10-7bf0-4070-aeaf-6bca65a0cfb8)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:00.740158 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-459a3121-1702-4a8d-9560-ce45fc4ce01f req-ba38fd8e-89c9-4166-826f-a5f6ccbe2cbe tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:00.745988 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,revision_number=7']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:00.759502 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-459a3121-1702-4a8d-9560-ce45fc4ce01f req-ba38fd8e-89c9-4166-826f-a5f6ccbe2cbe tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Calling delete_port for 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:01:00.833764 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5dce2e6-d248-42a1-acf1-a60f5120e6b0 req-70db96e9-9f7c-4039-b92d-f83d8943c7e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:00.844925 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a5dce2e6-d248-42a1-acf1-a60f5120e6b0 req-70db96e9-9f7c-4039-b92d-f83d8943c7e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.1380169 Sep 01 17:01:00.919194 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a5dce2e6-d248-42a1-acf1-a60f5120e6b0 req-5a15c3ea-c813-47bf-923b-56d276dfd803 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0669765 Sep 01 17:01:00.952125 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-459a3121-1702-4a8d-9560-ce45fc4ce01f req-ba38fd8e-89c9-4166-826f-a5f6ccbe2cbe tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:00.976709 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:01:00.978672 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55b93609-5b5b-4b0f-8444-6583c738e840 req-065d93bb-fa68-44ac-bee3-8daedce27aac tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:00.981160 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-55b93609-5b5b-4b0f-8444-6583c738e840 req-065d93bb-fa68-44ac-bee3-8daedce27aac tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0978322 Sep 01 17:01:00.998000 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba38fd8e-89c9-4166-826f-a5f6ccbe2cbe tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Pushing event deleted for resources: {'Port': ['ID=1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:01.051105 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-459a3121-1702-4a8d-9560-ce45fc4ce01f req-ba38fd8e-89c9-4166-826f-a5f6ccbe2cbe tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] No DVR routers for this DVR port 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:01:01.056401 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-459a3121-1702-4a8d-9560-ce45fc4ce01f req-ba38fd8e-89c9-4166-826f-a5f6ccbe2cbe tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:01.058435 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-459a3121-1702-4a8d-9560-ce45fc4ce01f req-ba38fd8e-89c9-4166-826f-a5f6ccbe2cbe tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.69 "DELETE /v2.0/ports/1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 HTTP/1.1" status: 204 len: 173 time: 0.6437504 Sep 01 17:01:01.058888 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '05e4c24b-2664-4883-bc91-fbef674b70b4', 'name': 'network-vif-deleted', 'tag': '1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:01.061266 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be2e293c-f86b-41a5-ba4b-de790660757c" -d '{"events": [{"server_uuid": "05e4c24b-2664-4883-bc91-fbef674b70b4", "name": "network-vif-deleted", "tag": "1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:01.079545 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-55b93609-5b5b-4b0f-8444-6583c738e840 req-bd22647f-de94-42fc-a9d3-9355560411e4 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0906739 Sep 01 17:01:01.137861 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd7552de-3669-43f3-ae1d-e466058c3e17 x-openstack-request-id: req-fd7552de-3669-43f3-ae1d-e466058c3e17 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:01.138159 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "05e4c24b-2664-4883-bc91-fbef674b70b4", "name": "network-vif-deleted", "tag": "1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:01.138394 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-fd7552de-3669-43f3-ae1d-e466058c3e17 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:01.138816 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '05e4c24b-2664-4883-bc91-fbef674b70b4', 'name': 'network-vif-deleted', 'tag': '1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9', 'status': 'completed', 'code': 200} Sep 01 17:01:01.745076 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f5203052-003b-4e95-bfb5-de0d9e98a7d4 req-4d75cdc1-4243-406a-8b9b-46b81c487007 tempest-VolumesNegativeTest-1645982416 tempest-VolumesNegativeTest-1645982416-project] 10.222.0.67 "GET /v2.0/ports?device_id=05e4c24b-2664-4883-bc91-fbef674b70b4 HTTP/1.1" status: 200 len: 210 time: 0.0556695 Sep 01 17:01:02.092045 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-248f6c13-1ba6-4105-825d-f41878f48f2e req-07d89c76-0f58-4567-ab5d-32380c2fdd0a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:02.102447 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-248f6c13-1ba6-4105-825d-f41878f48f2e req-07d89c76-0f58-4567-ab5d-32380c2fdd0a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0775242 Sep 01 17:01:02.150307 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-248f6c13-1ba6-4105-825d-f41878f48f2e req-1cf0651e-c4b2-43bc-9cce-4333deab3b63 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431490 Sep 01 17:01:02.222976 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b92f91d8-1b76-44de-8df4-0735ca66e70e req-661fb3d8-bce4-4a48-b77a-6883889036fb tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:02.224591 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b92f91d8-1b76-44de-8df4-0735ca66e70e req-661fb3d8-bce4-4a48-b77a-6883889036fb tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0596039 Sep 01 17:01:02.267124 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b92f91d8-1b76-44de-8df4-0735ca66e70e req-1de12eff-db07-4fe7-ad95-79a0d1e479e5 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0352910 Sep 01 17:01:02.843390 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beb05a2f-1ffc-470a-addb-84da1515c6aa req-856ab9a5-ba77-42cf-84fa-c5e91bb5de45 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:02.845116 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-beb05a2f-1ffc-470a-addb-84da1515c6aa req-856ab9a5-ba77-42cf-84fa-c5e91bb5de45 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 945 time: 0.0749152 Sep 01 17:01:02.897653 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-beb05a2f-1ffc-470a-addb-84da1515c6aa req-21f91d0f-0829-46d0-9964-44674399bf52 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464442 Sep 01 17:01:02.926936 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 55762) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:03.192911 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bdfd5613-49bb-48ce-bedb-3b25e6ddede4 tempest-TestMinimumBasicScenario-410544325 tempest-TestMinimumBasicScenario-410544325-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:03.199927 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-bdfd5613-49bb-48ce-bedb-3b25e6ddede4 tempest-TestMinimumBasicScenario-410544325 tempest-TestMinimumBasicScenario-410544325-project-admin] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 1093 time: 0.2690103 Sep 01 17:01:03.200459 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 55768) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:03.205057 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Request body: {'floatingip': {'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'port_id': '6f9364de-2626-4bc4-828f-69a19d15adc9', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'fixed_ip_address': '172.20.0.7'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:03.235121 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for floatingip, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:03.349069 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-588798c5-807b-4a30-9171-10fa353b79e8 req-703cd1dd-3def-49df-a79d-36b6c021a010 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:03.358037 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-588798c5-807b-4a30-9171-10fa353b79e8 req-703cd1dd-3def-49df-a79d-36b6c021a010 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0777328 Sep 01 17:01:03.435534 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-588798c5-807b-4a30-9171-10fa353b79e8 req-e9e86762-1c1e-4cc6-8957-23c21bfc3d0d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0763750 Sep 01 17:01:03.485416 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4167d1b8-c80e-4a74-ac2f-8c3e277b7e5f req-a3ed312d-d9f4-4078-9cbd-b99392608a45 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:03.489856 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4167d1b8-c80e-4a74-ac2f-8c3e277b7e5f req-a3ed312d-d9f4-4078-9cbd-b99392608a45 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.1093528 Sep 01 17:01:03.527788 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:03.577794 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4167d1b8-c80e-4a74-ac2f-8c3e277b7e5f req-b726b6e2-47fd-40ea-990a-34fdc8c612e4 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0790186 Sep 01 17:01:03.663117 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Allocated IP 172.27.1.244 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/765b7908-cf99-4b05-a9c2-94a095a951d2) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:01:03.812744 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:03.862225 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:03.901883 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:01:03.906425 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:01:03.914234 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:01:03.952121 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event updated for resources: {'Port': ['ID=765b7908-cf99-4b05-a9c2-94a095a951d2,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:04.247466 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:01:04.282728 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:01:04.291583 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 1bbf3b9c-86a5-4113-9ccf-0cefb35ab2b9 not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:01:04.332566 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:04.405095 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:04.611723 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for port, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:04.621247 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d260dc-2b84-45ff-861d-92da49fc1434 req-16ab0bf8-47b1-4b2c-a867-a52219966b99 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:04.623129 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-04d260dc-2b84-45ff-861d-92da49fc1434 req-16ab0bf8-47b1-4b2c-a867-a52219966b99 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0881937 Sep 01 17:01:04.624936 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6279726'] for port, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:04.755629 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event updated for resources: {'Port': ['ID=765b7908-cf99-4b05-a9c2-94a095a951d2,revision_number=2']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:04.778032 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-04d260dc-2b84-45ff-861d-92da49fc1434 req-4a288d3e-6332-49fc-8494-9ec733701e8b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1425405 Sep 01 17:01:04.782829 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:04.837428 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70889a36-9b4d-40c5-aaea-742e50f4c707 req-13f2040e-3cd4-4d5e-922a-1b67b7c671cd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:04.837428 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-70889a36-9b4d-40c5-aaea-742e50f4c707 req-13f2040e-3cd4-4d5e-922a-1b67b7c671cd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.1582050 Sep 01 17:01:04.924134 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-70889a36-9b4d-40c5-aaea-742e50f4c707 req-26295c33-1b15-4cf5-a33a-56ab676cbadb tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0794523 Sep 01 17:01:04.936538 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.l3_db [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Floating IP dcc11e71-51e1-4223-82de-de5185af273e associated. External IP: 172.27.1.244, port: 6f9364de-2626-4bc4-828f-69a19d15adc9. Sep 01 17:01:05.222146 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Router 13010fed-52ce-4d2e-bd27-6579300a2565 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:01:05.344843 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:01:05.364750 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dfcc05f-a38e-49c8-b22a-5d410aeddd98 None None] Sync routers for ids ['13010fed-52ce-4d2e-bd27-6579300a2565'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:01:05.378009 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dfcc05f-a38e-49c8-b22a-5d410aeddd98 None None] Routers {'13010fed-52ce-4d2e-bd27-6579300a2565'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:01:05.378974 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-5dfcc05f-a38e-49c8-b22a-5d410aeddd98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:00:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['13010fed-52ce-4d2e-bd27-6579300a2565'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:01:05.404934 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:05.444170 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 55786) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:05.444753 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-991b74eb-2b7e-4648-a092-08f04dd3a413 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2415450 Sep 01 17:01:05.444753 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'tag': '6f9364de-2626-4bc4-828f-69a19d15adc9'}] {{(pid=93836) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:05.446422 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}60a7e58791dd3a103db7a0d35103b09d0a4cb2c205e1177c181e158a6fe3866f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa5cab5a-9395-4d86-8d3e-d29ffc78d2bc" -d '{"events": [{"name": "network-changed", "server_uuid": "f84d355d-ae15-4f65-860a-2ccf43911f7e", "tag": "6f9364de-2626-4bc4-828f-69a19d15adc9"}]}' {{(pid=93836) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:05.456514 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-b28d4330-dba0-4ab0-ba21-781d98f897bc tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-561193278', 'description': 'tempest-secgroup-smoke-561193278 description', 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:05.496543 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-b28d4330-dba0-4ab0-ba21-781d98f897bc tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:05.496798 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6ee9c0e8-1ed8-4cb9-8885-2761645f1234 x-openstack-request-id: req-6ee9c0e8-1ed8-4cb9-8885-2761645f1234 {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:05.497013 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f84d355d-ae15-4f65-860a-2ccf43911f7e", "tag": "6f9364de-2626-4bc4-828f-69a19d15adc9", "status": "completed", "code": 200}]} {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:05.497302 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-6ee9c0e8-1ed8-4cb9-8885-2761645f1234 {{(pid=93836) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:05.497804 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'tag': '6f9364de-2626-4bc4-828f-69a19d15adc9', 'status': 'completed', 'code': 200} Sep 01 17:01:05.543730 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-5dfcc05f-a38e-49c8-b22a-5d410aeddd98 None None] Set router 13010fed-52ce-4d2e-bd27-6579300a2565 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:01:05.616589 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa5cab5a-9395-4d86-8d3e-d29ffc78d2bc req-a8cceb24-2b15-48d0-8cec-e209b74889f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:05.618520 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-fa5cab5a-9395-4d86-8d3e-d29ffc78d2bc req-a8cceb24-2b15-48d0-8cec-e209b74889f4 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=ccf739a17862469f9bbcedc5abe17cd1&device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 1098 time: 0.0652814 Sep 01 17:01:05.646333 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-b28d4330-dba0-4ab0-ba21-781d98f897bc tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:05.660819 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-b28d4330-dba0-4ab0-ba21-781d98f897bc tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:05.733217 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-b28d4330-dba0-4ab0-ba21-781d98f897bc tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:05.737516 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 55792) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:05.737678 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-b28d4330-dba0-4ab0-ba21-781d98f897bc tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1792 time: 0.2934492 Sep 01 17:01:05.744702 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b28d4330-dba0-4ab0-ba21-781d98f897bc tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9dc24496-c4bd-4f26-b512-ce40d586de91,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:05.746148 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-a292a910-b262-45fe-ac37-5fe6731225b8 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Request body: {'security_group_rule': {'security_group_id': '9dc24496-c4bd-4f26-b512-ce40d586de91', 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:05.794449 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a292a910-b262-45fe-ac37-5fe6731225b8 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:05.795493 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa5cab5a-9395-4d86-8d3e-d29ffc78d2bc req-c86a7f7d-374d-4038-a2f6-94eafb6e60cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:05.797273 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-fa5cab5a-9395-4d86-8d3e-d29ffc78d2bc req-c86a7f7d-374d-4038-a2f6-94eafb6e60cf service neutron] 10.222.0.69 "GET /v2.0/networks?id=ab951243-4254-4532-9d93-c294f4a98543 HTTP/1.1" status: 200 len: 915 time: 0.1609774 Sep 01 17:01:05.899906 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-5dfcc05f-a38e-49c8-b22a-5d410aeddd98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19'}], 'enable_snat': True}, 'gw_port_id': 'a4a1a622-487f-4052-a386-30130de5442b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T16:59:36Z', 'revision_number': 4, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port': {'id': 'a4a1a622-487f-4052-a386-30130de5442b', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:88:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:33Z', 'updated_at': '2021-09-01T16:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': 'dcc11e71-51e1-4223-82de-de5185af273e', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'floating_ip_address': '172.27.1.244', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'port_id': '6f9364de-2626-4bc4-828f-69a19d15adc9', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 456, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'mac_address': 'fa:16:3e:84:dd:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:01:04Z', 'updated_at': '2021-09-01T17:01:04Z', 'revision_number': 0, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '21fd7876-56d5-4a25-811b-f3b09625dc9b', 'name': '', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'mac_address': 'fa:16:3e:43:12:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:35Z', 'updated_at': '2021-09-01T16:59:42Z', 'revision_number': 5, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'subnets': [{'id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:01:05.939831 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a292a910-b262-45fe-ac37-5fe6731225b8 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:05.949113 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dfcc05f-a38e-49c8-b22a-5d410aeddd98 None None] Checking router: 13010fed-52ce-4d2e-bd27-6579300a2565 for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:01:05.958448 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a292a910-b262-45fe-ac37-5fe6731225b8 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:05.970271 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dfcc05f-a38e-49c8-b22a-5d410aeddd98 None None] Routers {'13010fed-52ce-4d2e-bd27-6579300a2565'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:01:05.971470 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-5dfcc05f-a38e-49c8-b22a-5d410aeddd98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:00:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['13010fed-52ce-4d2e-bd27-6579300a2565'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:01:05.982348 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-fa5cab5a-9395-4d86-8d3e-d29ffc78d2bc req-8fd5b7f8-668a-40ca-acbb-2fe3a5f45dfc service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6f9364de-2626-4bc4-828f-69a19d15adc9 HTTP/1.1" status: 200 len: 999 time: 0.1751835 Sep 01 17:01:06.002298 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a292a910-b262-45fe-ac37-5fe6731225b8 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=889b53a0-614f-4fdc-b761-327095228918,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:06.014423 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e882dfde-f581-437e-b02b-1052548cd513 req-1f6330ef-8af8-41b8-9f15-623522e18772 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:06.015972 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e882dfde-f581-437e-b02b-1052548cd513 req-1f6330ef-8af8-41b8-9f15-623522e18772 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.1117239 Sep 01 17:01:06.017224 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a292a910-b262-45fe-ac37-5fe6731225b8 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:06.020922 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-a292a910-b262-45fe-ac37-5fe6731225b8 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2794609 Sep 01 17:01:06.021821 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 55800) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:06.030133 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-0f4ec949-ad86-4a93-ac9a-5ae185b8b124 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Request body: {'security_group_rule': {'security_group_id': '9dc24496-c4bd-4f26-b512-ce40d586de91', 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:06.137625 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e882dfde-f581-437e-b02b-1052548cd513 req-333255ff-5b75-4ee8-9bb0-a76ee3e6087b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1004446 Sep 01 17:01:06.156365 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa5cab5a-9395-4d86-8d3e-d29ffc78d2bc req-a7d66dbb-cba7-4aed-b714-5b5c055abf25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:06.161906 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-fa5cab5a-9395-4d86-8d3e-d29ffc78d2bc req-a7d66dbb-cba7-4aed-b714-5b5c055abf25 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=eda7763d-791a-46fa-8a76-190c2898271d HTTP/1.1" status: 200 len: 853 time: 0.1669798 Sep 01 17:01:06.167993 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-5dfcc05f-a38e-49c8-b22a-5d410aeddd98 None None] Set router 13010fed-52ce-4d2e-bd27-6579300a2565 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:01:06.176561 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0f4ec949-ad86-4a93-ac9a-5ae185b8b124 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:06.247941 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa5cab5a-9395-4d86-8d3e-d29ffc78d2bc req-d38bb4c4-ac6d-4fda-a844-dbe23d9db59e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:06.249902 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-fa5cab5a-9395-4d86-8d3e-d29ffc78d2bc req-d38bb4c4-ac6d-4fda-a844-dbe23d9db59e service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=ab951243-4254-4532-9d93-c294f4a98543&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0769911 Sep 01 17:01:06.407593 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-fa5cab5a-9395-4d86-8d3e-d29ffc78d2bc req-618b85de-6f4d-4bcf-8fc6-84e44d2e47f8 service neutron] 10.222.0.69 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1480453 Sep 01 17:01:06.482305 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d347d22d-2bee-4b4c-b37e-ebf5fb8bca4b req-ea77932a-43b6-4710-b46d-1e330e69d458 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:06.494141 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d347d22d-2bee-4b4c-b37e-ebf5fb8bca4b req-ea77932a-43b6-4710-b46d-1e330e69d458 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.4185200 Sep 01 17:01:06.514791 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-5dfcc05f-a38e-49c8-b22a-5d410aeddd98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19'}], 'enable_snat': True}, 'gw_port_id': 'a4a1a622-487f-4052-a386-30130de5442b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T16:59:36Z', 'revision_number': 4, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port': {'id': 'a4a1a622-487f-4052-a386-30130de5442b', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:88:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:33Z', 'updated_at': '2021-09-01T16:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': 'dcc11e71-51e1-4223-82de-de5185af273e', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'floating_ip_address': '172.27.1.244', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'port_id': '6f9364de-2626-4bc4-828f-69a19d15adc9', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 456, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'mac_address': 'fa:16:3e:84:dd:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:01:04Z', 'updated_at': '2021-09-01T17:01:04Z', 'revision_number': 0, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '21fd7876-56d5-4a25-811b-f3b09625dc9b', 'name': '', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'mac_address': 'fa:16:3e:43:12:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:35Z', 'updated_at': '2021-09-01T16:59:42Z', 'revision_number': 5, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'subnets': [{'id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:01:06.550084 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dfcc05f-a38e-49c8-b22a-5d410aeddd98 None None] The sync data for ids ['13010fed-52ce-4d2e-bd27-6579300a2565'] in dv-cinder-799668-16-iscsi is: [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19'}], 'enable_snat': True}, 'gw_port_id': 'a4a1a622-487f-4052-a386-30130de5442b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T16:59:36Z', 'revision_number': 4, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port': {'id': 'a4a1a622-487f-4052-a386-30130de5442b', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:88:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:33Z', 'updated_at': '2021-09-01T16:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': 'dcc11e71-51e1-4223-82de-de5185af273e', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'floating_ip_address': '172.27.1.244', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'port_id': '6f9364de-2626-4bc4-828f-69a19d15adc9', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 456, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'mac_address': 'fa:16:3e:84:dd:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:01:04Z', 'updated_at': '2021-09-01T17:01:04Z', 'revision_number': 0, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '21fd7876-56d5-4a25-811b-f3b09625dc9b', 'name': '', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'mac_address': 'fa:16:3e:43:12:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:35Z', 'updated_at': '2021-09-01T16:59:42Z', 'revision_number': 5, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'subnets': [{'id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:01:06.559510 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-fa5cab5a-9395-4d86-8d3e-d29ffc78d2bc req-035828b7-4bf7-4e5d-9dd8-7d23ec790623 service neutron] 10.222.0.69 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1411157 Sep 01 17:01:06.567550 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d347d22d-2bee-4b4c-b37e-ebf5fb8bca4b req-0e0040bb-5f30-48cc-ab0a-9bbf6cfd0e13 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0722663 Sep 01 17:01:06.587610 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0f4ec949-ad86-4a93-ac9a-5ae185b8b124 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:06.592530 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0f4ec949-ad86-4a93-ac9a-5ae185b8b124 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:06.612438 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f4ec949-ad86-4a93-ac9a-5ae185b8b124 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5733030e-43b3-4cf8-b037-b56362aef6b8,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:06.619960 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0f4ec949-ad86-4a93-ac9a-5ae185b8b124 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:06.623987 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-0f4ec949-ad86-4a93-ac9a-5ae185b8b124 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5977657 Sep 01 17:01:06.623987 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 55804) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:06.628542 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-7924ea6f-c055-4d38-a8f2-b9a43d6f29d9 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Request body: {'security_group_rule': {'security_group_id': '9dc24496-c4bd-4f26-b512-ce40d586de91', 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:06.668305 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7924ea6f-c055-4d38-a8f2-b9a43d6f29d9 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:06.750769 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7924ea6f-c055-4d38-a8f2-b9a43d6f29d9 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:06.760703 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7924ea6f-c055-4d38-a8f2-b9a43d6f29d9 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:06.784182 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7924ea6f-c055-4d38-a8f2-b9a43d6f29d9 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6cd1165d-fe5e-4029-b6d9-9381766eee27,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:06.787857 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7924ea6f-c055-4d38-a8f2-b9a43d6f29d9 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:06.792165 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-7924ea6f-c055-4d38-a8f2-b9a43d6f29d9 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1645114 Sep 01 17:01:06.792664 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 55806) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:06.803923 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-f0532efa-587e-4411-8748-04aac101441c tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Request body: {'security_group_rule': {'security_group_id': '9dc24496-c4bd-4f26-b512-ce40d586de91', 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:06.857814 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f0532efa-587e-4411-8748-04aac101441c tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:06.895113 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9cbe8eb4-3b98-4a15-a89f-e72fc967c648 None None] New status for floating IP dcc11e71-51e1-4223-82de-de5185af273e: ACTIVE {{(pid=93837) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:01:06.936075 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f0532efa-587e-4411-8748-04aac101441c tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:06.940367 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f0532efa-587e-4411-8748-04aac101441c tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:06.958944 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0532efa-587e-4411-8748-04aac101441c tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2f4582f6-b13d-4c3f-a5bd-81accbf90b89,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:06.975642 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f0532efa-587e-4411-8748-04aac101441c tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:06.980326 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-f0532efa-587e-4411-8748-04aac101441c tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1836782 Sep 01 17:01:06.980509 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 55810) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:06.985662 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-bd922f1d-61b6-4605-950c-c686a92b649a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Request body: {'security_group_rule': {'security_group_id': '9dc24496-c4bd-4f26-b512-ce40d586de91', 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:07.020890 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.securitygroups_db [None req-bd922f1d-61b6-4605-950c-c686a92b649a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Project ccf739a17862469f9bbcedc5abe17cd1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 01 17:01:07.027932 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bd922f1d-61b6-4605-950c-c686a92b649a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:07.111017 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bd922f1d-61b6-4605-950c-c686a92b649a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:07.116570 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bd922f1d-61b6-4605-950c-c686a92b649a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:07.141190 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd922f1d-61b6-4605-950c-c686a92b649a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=529ef5da-de82-4626-9b16-8a2f06ad3208,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:07.152530 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bd922f1d-61b6-4605-950c-c686a92b649a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:07.157228 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-bd922f1d-61b6-4605-950c-c686a92b649a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1728473 Sep 01 17:01:07.157597 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 55812) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:07.164041 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-f870d7d3-e752-4655-a4ef-3fb5276cf58a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Request body: {'security_group_rule': {'security_group_id': '9dc24496-c4bd-4f26-b512-ce40d586de91', 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:07.203831 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.securitygroups_db [None req-f870d7d3-e752-4655-a4ef-3fb5276cf58a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Project ccf739a17862469f9bbcedc5abe17cd1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 01 17:01:07.211569 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f870d7d3-e752-4655-a4ef-3fb5276cf58a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:07.309254 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6497a80-7b0f-4efa-951d-5eec1589a4cd req-33094940-6bb4-402c-ac92-f630c937ab74 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:07.313678 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c6497a80-7b0f-4efa-951d-5eec1589a4cd req-33094940-6bb4-402c-ac92-f630c937ab74 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0898392 Sep 01 17:01:07.340461 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f870d7d3-e752-4655-a4ef-3fb5276cf58a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:07.348808 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f870d7d3-e752-4655-a4ef-3fb5276cf58a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:07.379170 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c6497a80-7b0f-4efa-951d-5eec1589a4cd req-599944cd-650f-4df5-8836-72b689f77961 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0598524 Sep 01 17:01:07.382499 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f870d7d3-e752-4655-a4ef-3fb5276cf58a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5957fe39-a8b0-42c5-9a4c-9059349a82f3,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:07.393075 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f870d7d3-e752-4655-a4ef-3fb5276cf58a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:07.394357 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-f870d7d3-e752-4655-a4ef-3fb5276cf58a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2356358 Sep 01 17:01:07.490022 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7e380c67-5dcb-46ba-99c0-b007611166e3 req-3a700009-47b9-48fe-9b2c-cbc6b66fa45b tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-561193278&fields=id&tenant_id=ccf739a17862469f9bbcedc5abe17cd1 HTTP/1.1" status: 200 len: 267 time: 0.0409348 Sep 01 17:01:07.544111 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e380c67-5dcb-46ba-99c0-b007611166e3 req-89d97ca3-e954-4905-bbf7-9ae6c79f367d tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:07.554098 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7e380c67-5dcb-46ba-99c0-b007611166e3 req-89d97ca3-e954-4905-bbf7-9ae6c79f367d tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 945 time: 0.0603886 Sep 01 17:01:07.560618 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [req-7e380c67-5dcb-46ba-99c0-b007611166e3 req-880153c1-c314-485d-859c-94ada7454c77 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Request body: {'port': {'security_groups': ['66d5c8c4-8327-4b83-9ae2-27a6ee182ca6', '9dc24496-c4bd-4f26-b512-ce40d586de91']}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:07.641952 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-7e380c67-5dcb-46ba-99c0-b007611166e3 req-880153c1-c314-485d-859c-94ada7454c77 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:07.797809 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-063e41e1-4064-466f-a1ba-78f736a273ec req-c868b382-52ac-4239-952a-7d9e76d2e82c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:07.799559 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-063e41e1-4064-466f-a1ba-78f736a273ec req-c868b382-52ac-4239-952a-7d9e76d2e82c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.1426282 Sep 01 17:01:07.896417 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-063e41e1-4064-466f-a1ba-78f736a273ec req-cd434b3b-2677-4fc8-885a-2745bf3fc262 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0872724 Sep 01 17:01:07.954169 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [req-7e380c67-5dcb-46ba-99c0-b007611166e3 req-880153c1-c314-485d-859c-94ada7454c77 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] For port 6f9364de-2626-4bc4-828f-69a19d15adc9, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=6f9364de-2626-4bc4-828f-69a19d15adc9,segment=NetworkSegment(bd15a57e-34c6-42ac-abbb-bea94ad6f705),segment_id=bd15a57e-34c6-42ac-abbb-bea94ad6f705)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:07.995062 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-7e380c67-5dcb-46ba-99c0-b007611166e3 req-880153c1-c314-485d-859c-94ada7454c77 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for port, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:08.001423 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-7e380c67-5dcb-46ba-99c0-b007611166e3 req-880153c1-c314-485d-859c-94ada7454c77 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6279726'] for port, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:08.040896 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['6f9364de-2626-4bc4-828f-69a19d15adc9'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:01:08.108679 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-880153c1-c314-485d-859c-94ada7454c77 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event updated for resources: {'Port': ['ID=6f9364de-2626-4bc4-828f-69a19d15adc9,revision_number=6']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:08.121789 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e380c67-5dcb-46ba-99c0-b007611166e3 req-880153c1-c314-485d-859c-94ada7454c77 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:08.122663 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-7e380c67-5dcb-46ba-99c0-b007611166e3 req-880153c1-c314-485d-859c-94ada7454c77 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for port, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:08.124312 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7e380c67-5dcb-46ba-99c0-b007611166e3 req-880153c1-c314-485d-859c-94ada7454c77 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "PUT /v2.0/ports/6f9364de-2626-4bc4-828f-69a19d15adc9 HTTP/1.1" status: 200 len: 981 time: 0.5689409 Sep 01 17:01:08.124790 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'tag': '6f9364de-2626-4bc4-828f-69a19d15adc9'}] {{(pid=93836) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:08.128475 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}60a7e58791dd3a103db7a0d35103b09d0a4cb2c205e1177c181e158a6fe3866f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b02f4952-d626-4ca3-886f-1065e74a6b76" -d '{"events": [{"name": "network-changed", "server_uuid": "f84d355d-ae15-4f65-860a-2ccf43911f7e", "tag": "6f9364de-2626-4bc4-828f-69a19d15adc9"}]}' {{(pid=93836) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:08.201581 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-825b6ba7-75be-4b6f-bd41-a032250de2c5 x-openstack-request-id: req-825b6ba7-75be-4b6f-bd41-a032250de2c5 {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:08.202199 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f84d355d-ae15-4f65-860a-2ccf43911f7e", "tag": "6f9364de-2626-4bc4-828f-69a19d15adc9", "status": "completed", "code": 200}]} {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:08.202199 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-825b6ba7-75be-4b6f-bd41-a032250de2c5 {{(pid=93836) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:08.203243 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'tag': '6f9364de-2626-4bc4-828f-69a19d15adc9', 'status': 'completed', 'code': 200} Sep 01 17:01:08.284982 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b02f4952-d626-4ca3-886f-1065e74a6b76 req-82ec261f-824a-41ef-af10-812f6b2817b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:08.285622 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b02f4952-d626-4ca3-886f-1065e74a6b76 req-82ec261f-824a-41ef-af10-812f6b2817b9 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=ccf739a17862469f9bbcedc5abe17cd1&device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 1137 time: 0.0641477 Sep 01 17:01:08.305907 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['6f9364de-2626-4bc4-828f-69a19d15adc9'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:01:08.365064 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25bfa4f0-3bba-45e8-aff1-538f28a93b9a req-22ebded9-1717-4ee6-8f1f-0336aa301cb1 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:08.366991 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-25bfa4f0-3bba-45e8-aff1-538f28a93b9a req-22ebded9-1717-4ee6-8f1f-0336aa301cb1 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.1331379 Sep 01 17:01:08.424986 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-25bfa4f0-3bba-45e8-aff1-538f28a93b9a req-cc7a9466-5e6a-48cd-8cc7-c5d262c5ab70 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0513966 Sep 01 17:01:08.439517 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b02f4952-d626-4ca3-886f-1065e74a6b76 req-e5df9eae-7277-4572-8e83-bfa1b8aa1f24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:08.441297 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b02f4952-d626-4ca3-886f-1065e74a6b76 req-e5df9eae-7277-4572-8e83-bfa1b8aa1f24 service neutron] 10.222.0.69 "GET /v2.0/networks?id=ab951243-4254-4532-9d93-c294f4a98543 HTTP/1.1" status: 200 len: 915 time: 0.1473842 Sep 01 17:01:08.490544 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-f30932c7-59ba-4355-a0b1-2e253406481d None None] Provisioning complete for port 6f9364de-2626-4bc4-828f-69a19d15adc9 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:01:08.498004 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-f30932c7-59ba-4355-a0b1-2e253406481d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:08.544060 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b02f4952-d626-4ca3-886f-1065e74a6b76 req-aee073c5-1a11-4078-a6fd-c0c4fcc624bc service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6f9364de-2626-4bc4-828f-69a19d15adc9 HTTP/1.1" status: 200 len: 1001 time: 0.0922263 Sep 01 17:01:08.575392 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da669e63-aa4d-4c5d-b95a-b5d7392b834c req-aec215e1-160f-41a0-84ec-d85c149fffd9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:08.583892 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-da669e63-aa4d-4c5d-b95a-b5d7392b834c req-aec215e1-160f-41a0-84ec-d85c149fffd9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0628521 Sep 01 17:01:08.627644 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-da669e63-aa4d-4c5d-b95a-b5d7392b834c req-a6aef8e7-98ed-41ff-bd53-830879ba2c0c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422831 Sep 01 17:01:08.634400 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b02f4952-d626-4ca3-886f-1065e74a6b76 req-63da2391-59cc-4398-aa4d-43a78ffdcd86 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:08.636984 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b02f4952-d626-4ca3-886f-1065e74a6b76 req-63da2391-59cc-4398-aa4d-43a78ffdcd86 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=eda7763d-791a-46fa-8a76-190c2898271d HTTP/1.1" status: 200 len: 853 time: 0.0807021 Sep 01 17:01:08.728237 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b02f4952-d626-4ca3-886f-1065e74a6b76 req-94e0dc94-6fff-48d4-a7e3-0789275a96b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:08.729848 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b02f4952-d626-4ca3-886f-1065e74a6b76 req-94e0dc94-6fff-48d4-a7e3-0789275a96b8 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=ab951243-4254-4532-9d93-c294f4a98543&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0771189 Sep 01 17:01:08.904971 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b02f4952-d626-4ca3-886f-1065e74a6b76 req-9f1d41b3-18cb-449d-aaa0-95732f1a3050 service neutron] 10.222.0.69 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1655595 Sep 01 17:01:09.056364 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b02f4952-d626-4ca3-886f-1065e74a6b76 req-921cf6ad-19c7-42bd-aea8-064e8ea02de5 service neutron] 10.222.0.69 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1371346 Sep 01 17:01:09.114378 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-221d03fb-5f78-4110-9b30-5a91af419c0a req-e3717fb7-da8a-464d-b053-42ca2645e9be tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:09.116919 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-221d03fb-5f78-4110-9b30-5a91af419c0a req-e3717fb7-da8a-464d-b053-42ca2645e9be tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.1143031 Sep 01 17:01:09.177441 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-221d03fb-5f78-4110-9b30-5a91af419c0a req-68b9f5cc-d6f5-4841-b79e-af3893e6800a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548806 Sep 01 17:01:09.780585 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-498d6447-3c56-4000-9316-7ca5d49fc020 req-c64a532f-575a-4b2c-a60b-6e338dfe4f43 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:09.782240 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-498d6447-3c56-4000-9316-7ca5d49fc020 req-c64a532f-575a-4b2c-a60b-6e338dfe4f43 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0635576 Sep 01 17:01:09.832150 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-498d6447-3c56-4000-9316-7ca5d49fc020 req-18a9c7af-76ff-4c5a-80f1-64cf4001a19f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406687 Sep 01 17:01:10.324448 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b35c024-abce-44ff-ac82-2f3e7b8d6ae6 req-2d6728d0-fc72-4c3e-86e6-f095620c0c36 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:10.326461 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3b35c024-abce-44ff-ac82-2f3e7b8d6ae6 req-2d6728d0-fc72-4c3e-86e6-f095620c0c36 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0637860 Sep 01 17:01:10.369576 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3b35c024-abce-44ff-ac82-2f3e7b8d6ae6 req-b4c0233d-252c-4b7f-8baf-44fdb8bd84cb tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0368757 Sep 01 17:01:10.964135 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-274d4b15-2a3b-4f06-8924-eb458fc7442e req-ab135f8f-3419-43ea-9277-0c7256b8cddd tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:10.970073 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-274d4b15-2a3b-4f06-8924-eb458fc7442e req-ab135f8f-3419-43ea-9277-0c7256b8cddd tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0604773 Sep 01 17:01:11.033285 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-274d4b15-2a3b-4f06-8924-eb458fc7442e req-dcce8ac0-9cf3-4c6c-802a-64c009002e5f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0607352 Sep 01 17:01:11.481445 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a89fbf-38e3-4851-87ef-f14b1460bf97 req-9422f8e5-05b1-4863-9a06-1c7d21afcc29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:11.483012 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-32a89fbf-38e3-4851-87ef-f14b1460bf97 req-9422f8e5-05b1-4863-9a06-1c7d21afcc29 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 1098 time: 0.0564389 Sep 01 17:01:11.514692 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-dad9f3a6-646f-4a70-835b-80d62256bdb5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:11.516214 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-dad9f3a6-646f-4a70-835b-80d62256bdb5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/networks?id=8331b65a-166e-454c-a3c5-ed861dc82dfc HTTP/1.1" status: 200 len: 814 time: 0.1495740 Sep 01 17:01:11.541728 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-153a9c21-3f73-466c-b2f7-fed94bed162b req-b0a3461a-002c-479f-b975-ff13b3280e19 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:11.543431 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-153a9c21-3f73-466c-b2f7-fed94bed162b req-b0a3461a-002c-479f-b975-ff13b3280e19 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0874174 Sep 01 17:01:11.547942 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fd4674c9-a669-4a81-9c9e-6e63a5c2d25a tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/quotas/7032b30e75954f8da9ad2cb64f1f5ad1 HTTP/1.1" status: 200 len: 375 time: 0.0246537 Sep 01 17:01:11.589976 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a89fbf-38e3-4851-87ef-f14b1460bf97 req-9355c34f-58a5-4e01-93b7-679901b90bed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:11.591620 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-32a89fbf-38e3-4851-87ef-f14b1460bf97 req-9355c34f-58a5-4e01-93b7-679901b90bed service neutron] 10.222.0.69 "GET /v2.0/networks?id=2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 200 len: 917 time: 0.0995245 Sep 01 17:01:11.614238 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-153a9c21-3f73-466c-b2f7-fed94bed162b req-5099accb-9716-4c07-8693-54b3d434cb9c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632226 Sep 01 17:01:11.640380 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-8729b261-35a0-4dba-b3fc-e86ffb402434 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=7032b30e75954f8da9ad2cb64f1f5ad1&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0828426 Sep 01 17:01:11.684448 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-32a89fbf-38e3-4851-87ef-f14b1460bf97 req-c57c5d8d-c912-4c68-8557-9c513daebce7 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb HTTP/1.1" status: 200 len: 1000 time: 0.0706186 Sep 01 17:01:11.746040 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-c5a066b5-db5a-49ad-914b-631d6bc57d1c service neutron] 10.222.0.67 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0973094 Sep 01 17:01:11.751054 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a89fbf-38e3-4851-87ef-f14b1460bf97 req-d2ebf845-b551-4958-beca-359ce740d5a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:11.752932 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-32a89fbf-38e3-4851-87ef-f14b1460bf97 req-d2ebf845-b551-4958-beca-359ce740d5a1 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=58fe425a-6b3e-47bd-b5c0-e68ea7782780 HTTP/1.1" status: 200 len: 855 time: 0.0595250 Sep 01 17:01:11.802521 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a89fbf-38e3-4851-87ef-f14b1460bf97 req-9858332b-f7ed-48eb-a203-78e765ecdbbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:11.804440 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-32a89fbf-38e3-4851-87ef-f14b1460bf97 req-9858332b-f7ed-48eb-a203-78e765ecdbbd service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2f7bfe5e-0012-467f-ad7f-aea2467233ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0421329 Sep 01 17:01:11.851318 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-20523592-b1f4-4372-a180-aad053fd3138 service neutron] 10.222.0.67 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0955608 Sep 01 17:01:11.914649 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-32a89fbf-38e3-4851-87ef-f14b1460bf97 req-0330c2f0-ce14-4494-b666-9b14e7c3e4a3 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1008689 Sep 01 17:01:12.034009 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-32a89fbf-38e3-4851-87ef-f14b1460bf97 req-90b3eceb-0889-408a-9428-bbed77215216 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1117027 Sep 01 17:01:12.068239 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d716315e-1817-4ff2-88d4-613fbb960fe0 req-15d253c8-ff70-46e8-ba18-5f0c0ead59e5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 210 time: 0.0573220 Sep 01 17:01:12.194474 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb0d4a8e-e98e-4f1c-950c-925f0525911b req-0d159a0d-5364-4c76-a109-b2f0ad57dc3a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:12.196628 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fb0d4a8e-e98e-4f1c-950c-925f0525911b req-0d159a0d-5364-4c76-a109-b2f0ad57dc3a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0725706 Sep 01 17:01:12.255453 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fb0d4a8e-e98e-4f1c-950c-925f0525911b req-0c0bf31b-655a-4f53-afec-f7a1328839d0 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472674 Sep 01 17:01:12.741310 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-346acb6f-c7f6-496d-b0f8-26dadab4dbb6 req-868da165-93a9-48e4-8ee4-d5dc4b840c9f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:12.742948 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-346acb6f-c7f6-496d-b0f8-26dadab4dbb6 req-868da165-93a9-48e4-8ee4-d5dc4b840c9f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0534253 Sep 01 17:01:12.784820 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-346acb6f-c7f6-496d-b0f8-26dadab4dbb6 req-9516775d-fd73-41be-88df-ca37299b0dba tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0357397 Sep 01 17:01:13.196517 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-36079e4b-db51-43bb-bd0d-44726da17bee tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:13.198094 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-36079e4b-db51-43bb-bd0d-44726da17bee tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "GET /v2.0/networks?id=8331b65a-166e-454c-a3c5-ed861dc82dfc HTTP/1.1" status: 200 len: 814 time: 0.1328974 Sep 01 17:01:13.206099 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6310b1b6-aac5-465e-b2c7-9fbe19ca6dcc req-e9710b40-9040-4523-9fd2-eb9d55e5237e tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 210 time: 0.0295718 Sep 01 17:01:13.213689 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-a6b3904f-158b-4756-9e50-4cac345cb2af tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Request body: {'port': {'device_id': 'c48c7ff9-8c18-4eae-b554-12334f7fa2e6', 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc', 'admin_state_up': True, 'tenant_id': '7032b30e75954f8da9ad2cb64f1f5ad1'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:13.333540 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-a6b3904f-158b-4756-9e50-4cac345cb2af tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Made reservation on behalf of 7032b30e75954f8da9ad2cb64f1f5ad1 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:01:13.337111 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-a6b3904f-158b-4756-9e50-4cac345cb2af tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:13.394572 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af2fbe23-a11b-433c-a16c-0d1b892ba1ff req-ea307e72-3f8f-4538-9751-3e25c2a6b678 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:13.396069 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-af2fbe23-a11b-433c-a16c-0d1b892ba1ff req-ea307e72-3f8f-4538-9751-3e25c2a6b678 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0474482 Sep 01 17:01:13.444094 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-af2fbe23-a11b-433c-a16c-0d1b892ba1ff req-d5508f96-1ac0-4e91-88c3-0e305e1e2820 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401113 Sep 01 17:01:13.471410 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-a6b3904f-158b-4756-9e50-4cac345cb2af tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Allocated IP 172.20.0.2 (8331b65a-166e-454c-a3c5-ed861dc82dfc/fd025a14-8839-4451-a03e-bc7daeb612d0/45822242-f0ab-4492-b049-73735203e788) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:01:13.619243 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-a6b3904f-158b-4756-9e50-4cac345cb2af tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:13.656889 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-a6b3904f-158b-4756-9e50-4cac345cb2af tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:13.668713 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['3890e11d-5295-488a-9033-9814bb94bf69', '0cf2eaec-e9b1-4ad6-a894-84361c0fe80f', '7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:01:13.700070 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-a6b3904f-158b-4756-9e50-4cac345cb2af tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Network 8331b65a-166e-454c-a3c5-ed861dc82dfc is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:01:13.705027 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-a6b3904f-158b-4756-9e50-4cac345cb2af tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:01:13.708827 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-a6b3904f-158b-4756-9e50-4cac345cb2af tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:01:13.736777 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6b3904f-158b-4756-9e50-4cac345cb2af tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Pushing event updated for resources: {'Port': ['ID=45822242-f0ab-4492-b049-73735203e788,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:13.763208 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-a6b3904f-158b-4756-9e50-4cac345cb2af tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:13.763816 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-a6b3904f-158b-4756-9e50-4cac345cb2af tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:13.779180 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-a6b3904f-158b-4756-9e50-4cac345cb2af tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5696013 Sep 01 17:01:13.802314 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Request body: {'port': {'device_id': 'c48c7ff9-8c18-4eae-b554-12334f7fa2e6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:13.867270 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:13.914468 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26223976-be96-4dab-a329-c9f7d4497605 req-661dd0a0-a907-4a3f-befc-34b08d9c67df tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:13.916014 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-26223976-be96-4dab-a329-c9f7d4497605 req-661dd0a0-a907-4a3f-befc-34b08d9c67df tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0509009 Sep 01 17:01:13.956920 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-26223976-be96-4dab-a329-c9f7d4497605 req-83653cf4-e986-4590-831f-15ab111275fe tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0339758 Sep 01 17:01:14.135331 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 45822242-f0ab-4492-b049-73735203e788 {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:01:14.145656 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:14.160010 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Transition to ACTIVE for port object 45822242-f0ab-4492-b049-73735203e788 will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:01:14.165114 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:14.232349 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Pushing event updated for resources: {'Port': ['ID=45822242-f0ab-4492-b049-73735203e788,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:14.289809 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Attempting to bind port 45822242-f0ab-4492-b049-73735203e788 on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:01:14.290149 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Attempting to bind port 45822242-f0ab-4492-b049-73735203e788 by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:01:14.290486 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Attempting to bind port 45822242-f0ab-4492-b049-73735203e788 on network 8331b65a-166e-454c-a3c5-ed861dc82dfc {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:01:14.294986 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Port 45822242-f0ab-4492-b049-73735203e788 on network 8331b65a-166e-454c-a3c5-ed861dc82dfc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:01:14.295308 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Attempting to bind port 45822242-f0ab-4492-b049-73735203e788 on network 8331b65a-166e-454c-a3c5-ed861dc82dfc {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:01:14.300358 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 0, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:01:14.300700 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Checking segment: {'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:01:14.301091 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Bound using segment: {'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:01:14.301559 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Bound port: 45822242-f0ab-4492-b049-73735203e788, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dc2afa10-206e-4e07-821f-7de675db4aa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:01:14.302025 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:14.346186 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffe1af5-3a68-41f0-8dc5-4ad4a77879e9 req-2a5a3ad8-ecc0-4917-8ae5-448c91b9f82a tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:14.348222 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4ffe1af5-3a68-41f0-8dc5-4ad4a77879e9 req-2a5a3ad8-ecc0-4917-8ae5-448c91b9f82a tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 943 time: 0.0628836 Sep 01 17:01:14.388974 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] For port 45822242-f0ab-4492-b049-73735203e788, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:01:14.392121 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] For port 45822242-f0ab-4492-b049-73735203e788, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=45822242-f0ab-4492-b049-73735203e788,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:01:14.398220 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:14.404312 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4ffe1af5-3a68-41f0-8dc5-4ad4a77879e9 req-d6fc481c-e5c8-4d68-8586-6d003cb3b7d1 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470040 Sep 01 17:01:14.441316 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:14.441955 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:14.443333 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] 10.222.0.69 "PUT /v2.0/ports/45822242-f0ab-4492-b049-73735203e788 HTTP/1.1" status: 200 len: 1093 time: 0.6456945 Sep 01 17:01:14.444541 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c48c7ff9-8c18-4eae-b554-12334f7fa2e6', 'tag': '45822242-f0ab-4492-b049-73735203e788'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:14.447011 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e31a033d-d259-49a5-a6ca-f6b583918b24" -d '{"events": [{"name": "network-changed", "server_uuid": "c48c7ff9-8c18-4eae-b554-12334f7fa2e6", "tag": "45822242-f0ab-4492-b049-73735203e788"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:14.479590 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce3cdcd-3e48-41d5-af85-72ca6f4abc21 service neutron] Pushing event updated for resources: {'Port': ['ID=45822242-f0ab-4492-b049-73735203e788,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:14.519136 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8ac7688b-1a8f-4ae3-9a9d-365ae697b658 x-openstack-request-id: req-8ac7688b-1a8f-4ae3-9a9d-365ae697b658 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:14.519425 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c48c7ff9-8c18-4eae-b554-12334f7fa2e6", "tag": "45822242-f0ab-4492-b049-73735203e788", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:14.519672 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-8ac7688b-1a8f-4ae3-9a9d-365ae697b658 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:14.520067 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c48c7ff9-8c18-4eae-b554-12334f7fa2e6', 'tag': '45822242-f0ab-4492-b049-73735203e788', 'status': 'completed', 'code': 200} Sep 01 17:01:14.558033 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-3124999d-81c3-40d4-81b8-90bd4176e72b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:14.559714 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-3124999d-81c3-40d4-81b8-90bd4176e72b service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7032b30e75954f8da9ad2cb64f1f5ad1&device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 1096 time: 0.0564239 Sep 01 17:01:14.565230 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 56166) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:14.587059 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b66fe7ac-93c1-4121-b94d-6c76b24de094 req-9ef3487a-74f3-49fc-b8c3-f9ef46de3eb5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:14.588557 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b66fe7ac-93c1-4121-b94d-6c76b24de094 req-9ef3487a-74f3-49fc-b8c3-f9ef46de3eb5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0510643 Sep 01 17:01:14.609553 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-6dcd2c2d-b2c0-4309-be5c-7aaed0ed7094 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=45822242-f0ab-4492-b049-73735203e788 HTTP/1.1" status: 200 len: 217 time: 0.0377452 Sep 01 17:01:14.630977 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b66fe7ac-93c1-4121-b94d-6c76b24de094 req-0dbcc1d4-6eda-404c-b7e3-ff83e99dcd6e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0353105 Sep 01 17:01:14.666678 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-63b24e97-4a9a-4588-a579-8e07d3d59efd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:14.668166 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-63b24e97-4a9a-4588-a579-8e07d3d59efd service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd025a14-8839-4451-a03e-bc7daeb612d0 HTTP/1.1" status: 200 len: 854 time: 0.0499861 Sep 01 17:01:14.717323 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-c4f69850-fc24-412f-b8e2-4b04c027c613 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8331b65a-166e-454c-a3c5-ed861dc82dfc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0364399 Sep 01 17:01:14.732794 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-85fbb4af-a267-4f8e-870a-66066a406f82 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=d2a03b2bcd68480a8a5796825671a2f1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1664817 Sep 01 17:01:14.735349 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 56174) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:15.041959 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-259d5b35-6274-4b5e-b0a8-165e045e509a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:15.086304 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-259d5b35-6274-4b5e-b0a8-165e045e509a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:15.088377 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d32cd4-24ee-416e-9799-dd4e07e7e2f8 req-e015884e-2639-4682-8d04-8f57eac74ca9 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:15.093992 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d5d32cd4-24ee-416e-9799-dd4e07e7e2f8 req-e015884e-2639-4682-8d04-8f57eac74ca9 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0654960 Sep 01 17:01:15.098970 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-868f721f-3674-4e55-b7eb-3bc082bcb162 service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3464816 Sep 01 17:01:15.156905 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d5d32cd4-24ee-416e-9799-dd4e07e7e2f8 req-57b801d3-163a-404e-b925-4e6db09b6b5b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0601690 Sep 01 17:01:15.176689 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [req-7e6a97ae-52e9-4942-a526-234d9489aad2 req-fa75c4df-ee40-44bc-95c6-bd1c238d9e37 service neutron] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93836) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 17:01:15.177823 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7e6a97ae-52e9-4942-a526-234d9489aad2 req-fa75c4df-ee40-44bc-95c6-bd1c238d9e37 service neutron] 10.222.0.67 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0063066 Sep 01 17:01:15.211659 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-259d5b35-6274-4b5e-b0a8-165e045e509a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:15.214321 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-259d5b35-6274-4b5e-b0a8-165e045e509a admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:15.215461 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-259d5b35-6274-4b5e-b0a8-165e045e509a admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49 HTTP/1.1" status: 204 len: 168 time: 0.4792061 Sep 01 17:01:15.230526 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-259d5b35-6274-4b5e-b0a8-165e045e509a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d34eaae5-e6ad-4ca5-b77c-8ce2480ffd49,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:15.236981 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2f5ec74f-cf1e-4819-8849-f9f0f951d6cc req-722c78d9-a82f-4847-91da-e17c53bcf27a service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1191709 Sep 01 17:01:15.336124 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e31a033d-d259-49a5-a6ca-f6b583918b24 req-26ee6ca5-f9c8-4cea-8bed-7e4bf481c572 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:15.338714 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e31a033d-d259-49a5-a6ca-f6b583918b24 req-26ee6ca5-f9c8-4cea-8bed-7e4bf481c572 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7032b30e75954f8da9ad2cb64f1f5ad1&device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 1096 time: 0.0480721 Sep 01 17:01:15.376011 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-289ff855-4ca2-44c3-8167-d9f60b13d1fc req-13f79a8d-73e1-4dc4-8919-49f33914da9a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:15.377974 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-289ff855-4ca2-44c3-8167-d9f60b13d1fc req-13f79a8d-73e1-4dc4-8919-49f33914da9a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 945 time: 0.0670161 Sep 01 17:01:15.428799 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-289ff855-4ca2-44c3-8167-d9f60b13d1fc req-75ee30d9-07d2-42ac-9557-9045eb07c89a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433254 Sep 01 17:01:15.454673 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e31a033d-d259-49a5-a6ca-f6b583918b24 req-ee278522-312a-494d-9dbf-3b4068f14a49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:15.456319 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e31a033d-d259-49a5-a6ca-f6b583918b24 req-ee278522-312a-494d-9dbf-3b4068f14a49 service neutron] 10.222.0.69 "GET /v2.0/networks?id=8331b65a-166e-454c-a3c5-ed861dc82dfc HTTP/1.1" status: 200 len: 915 time: 0.1079750 Sep 01 17:01:15.523722 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e31a033d-d259-49a5-a6ca-f6b583918b24 req-ba71aa99-a119-4ebc-acbb-d3260ada25a4 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=45822242-f0ab-4492-b049-73735203e788 HTTP/1.1" status: 200 len: 217 time: 0.0491309 Sep 01 17:01:15.548548 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc28fb98-8b41-4770-8a8f-6fec70d279a5 req-c883437e-9f21-4a7b-96a3-a127bf4e66a5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:15.563097 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fc28fb98-8b41-4770-8a8f-6fec70d279a5 req-c883437e-9f21-4a7b-96a3-a127bf4e66a5 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 943 time: 0.0769818 Sep 01 17:01:15.609789 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e31a033d-d259-49a5-a6ca-f6b583918b24 req-6568cb81-58b9-4528-be33-8f96880c3cf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:15.610324 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e31a033d-d259-49a5-a6ca-f6b583918b24 req-6568cb81-58b9-4528-be33-8f96880c3cf7 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd025a14-8839-4451-a03e-bc7daeb612d0 HTTP/1.1" status: 200 len: 854 time: 0.0681775 Sep 01 17:01:15.613966 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fc28fb98-8b41-4770-8a8f-6fec70d279a5 req-a45258c1-d04b-4e41-9b14-405e5d6a37f1 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515034 Sep 01 17:01:15.654440 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e31a033d-d259-49a5-a6ca-f6b583918b24 req-5d3bdd41-0d01-4db4-a4ed-538213c1623a service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=8331b65a-166e-454c-a3c5-ed861dc82dfc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0327120 Sep 01 17:01:15.769786 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e31a033d-d259-49a5-a6ca-f6b583918b24 req-9a178acf-9a43-4769-b6b3-b020fbcb3ad1 service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0938032 Sep 01 17:01:15.875552 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e31a033d-d259-49a5-a6ca-f6b583918b24 req-ef95d342-9209-485e-8c4e-f4222ee959e5 service neutron] 10.222.0.69 "GET /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0958738 Sep 01 17:01:15.903410 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 56232) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:16.003238 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 56238) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:16.030756 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e05be18a-0060-4222-945e-28b824007738 req-1157d9fa-3081-4514-8fa5-7cb7ecb75a65 service neutron] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1262119 Sep 01 17:01:16.040107 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [req-e05be18a-0060-4222-945e-28b824007738 req-d7bed2b8-c0c9-471c-9778-6bfa51664b85 service neutron] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93835) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 17:01:16.041257 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e05be18a-0060-4222-945e-28b824007738 req-d7bed2b8-c0c9-471c-9778-6bfa51664b85 service neutron] 10.222.0.67 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0056043 Sep 01 17:01:16.057104 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-803385041-network', 'tenant_id': '7ddcba698dfe424a89ef6b0fa2e10ae6'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:16.080179 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] Made reservation on behalf of 7ddcba698dfe424a89ef6b0fa2e10ae6 for: {'network': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:01:16.082611 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:16.091467 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:16.184666 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:16.190046 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:16.212739 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] vlan segment allocate from pool success with {'vlan_id': 521, 'physical_network': 'physnet1'} {{(pid=93836) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 17:01:16.247273 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88fc5a2a-1857-470b-a3f9-70d8551b6f2f,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:16.265524 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:16.265876 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.segments_db [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] Added segment 908c9756-53a1-4c99-846c-262c66bbb074 of type vlan for network 50a57de3-5738-4399-9f1b-3d7d294c86dc Sep 01 17:01:16.315595 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:16.322335 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device f3cd3382-a1bb-4f12-b1b1-64bd000296fb no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:01:16.337332 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8afda0-c6b5-4655-9b2c-4aafb92c2e20 req-4ca9e89d-bf3a-486b-a863-652b0d6f91a0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:16.338917 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4a8afda0-c6b5-4655-9b2c-4aafb92c2e20 req-4ca9e89d-bf3a-486b-a863-652b0d6f91a0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.1111441 Sep 01 17:01:16.378952 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:16.380615 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:16.381757 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:16.407087 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:16.430256 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:16.432745 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c6c90e83-f459-4f95-a9c7-38bf274df8b3" -d '{"events": [{"server_uuid": "0678fbe1-e92f-49b6-93cd-5babcfc2de18", "name": "network-vif-unplugged", "status": "completed", "tag": "f3cd3382-a1bb-4f12-b1b1-64bd000296fb"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:16.440758 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4a8afda0-c6b5-4655-9b2c-4aafb92c2e20 req-ed11b65a-9671-4763-bd29-785e20500a1a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0905828 Sep 01 17:01:16.446248 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port f3cd3382-a1bb-4f12-b1b1-64bd000296fb, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:16.451008 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:16.458730 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.4517493 Sep 01 17:01:16.461181 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 56252) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:16.468724 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f986a7-d95b-442b-bbae-a66b35d1c405 admin admin] Pushing event updated for resources: {'Network': ['ID=50a57de3-5738-4399-9f1b-3d7d294c86dc,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:16.483272 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-8c11a74a-2cca-4452-b29c-ef6afc9e1ef3 admin admin] Request body: {'subnet': {'network_id': '50a57de3-5738-4399-9f1b-3d7d294c86dc', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-803385041-subnet', 'tenant_id': '7ddcba698dfe424a89ef6b0fa2e10ae6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:16.487825 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4fb3d837-ecfe-42c2-a892-535cc6a16960 x-openstack-request-id: req-4fb3d837-ecfe-42c2-a892-535cc6a16960 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:16.488114 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0678fbe1-e92f-49b6-93cd-5babcfc2de18", "name": "network-vif-unplugged", "status": "failed", "tag": "f3cd3382-a1bb-4f12-b1b1-64bd000296fb", "code": 422}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:16.488363 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-4fb3d837-ecfe-42c2-a892-535cc6a16960 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:16.488757 dv-cinder-799668-16-iscsi neutron-server[93837]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'code': 422} returned with failed status Sep 01 17:01:16.491297 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network 50a57de3-5738-4399-9f1b-3d7d294c86dc details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 17:01:16.508488 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c11a74a-2cca-4452-b29c-ef6afc9e1ef3 admin admin] Made reservation on behalf of 7ddcba698dfe424a89ef6b0fa2e10ae6 for: {'subnet': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:01:16.511920 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8c11a74a-2cca-4452-b29c-ef6afc9e1ef3 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5120093'] for subnet, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:16.575888 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6d6ca1-f537-4499-8a86-9641d12d3ca1 req-38529e03-3fe9-477b-b57f-3f6b03bf2347 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:16.578126 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0c6d6ca1-f537-4499-8a86-9641d12d3ca1 req-38529e03-3fe9-477b-b57f-3f6b03bf2347 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0531497 Sep 01 17:01:16.596108 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,revision_number=8']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:16.648036 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0c6d6ca1-f537-4499-8a86-9641d12d3ca1 req-8aa93289-c810-42fd-a870-9c504023088c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0585816 Sep 01 17:01:16.725856 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8c11a74a-2cca-4452-b29c-ef6afc9e1ef3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7343016', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5120075'] for subnet, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:16.743362 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0486dbe5-e7e7-4f35-9d16-54212d3346a7 req-d7ff2130-1548-4c49-824a-6af07339d340 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:16.744955 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0486dbe5-e7e7-4f35-9d16-54212d3346a7 req-d7ff2130-1548-4c49-824a-6af07339d340 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 943 time: 0.0552399 Sep 01 17:01:16.783049 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0486dbe5-e7e7-4f35-9d16-54212d3346a7 req-cfe86163-9865-4146-9e1c-d3c3b5e427b8 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321579 Sep 01 17:01:16.785949 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c11a74a-2cca-4452-b29c-ef6afc9e1ef3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=666c0d30-db52-4561-9b93-97a824a51a0d,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:16.795657 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c11a74a-2cca-4452-b29c-ef6afc9e1ef3 admin admin] Checking segment: {'id': '908c9756-53a1-4c99-846c-262c66bbb074', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '50a57de3-5738-4399-9f1b-3d7d294c86dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:01:16.796003 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c11a74a-2cca-4452-b29c-ef6afc9e1ef3 admin admin] Network hostable DHCP agents. Network: 50a57de3-5738-4399-9f1b-3d7d294c86dc, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93835) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 17:01:16.812689 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c11a74a-2cca-4452-b29c-ef6afc9e1ef3 admin admin] Network 50a57de3-5738-4399-9f1b-3d7d294c86dc is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93835) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 17:01:16.821025 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-8c11a74a-2cca-4452-b29c-ef6afc9e1ef3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, 50a57de3-5738-4399-9f1b-3d7d294c86dc) {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:01:16.824901 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c11a74a-2cca-4452-b29c-ef6afc9e1ef3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:16.825550 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8c11a74a-2cca-4452-b29c-ef6afc9e1ef3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:16.830840 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97a45328-83d7-455e-b43f-118f34ae3c91 None None] Network 50a57de3-5738-4399-9f1b-3d7d294c86dc requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:01:16.841934 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-8c11a74a-2cca-4452-b29c-ef6afc9e1ef3 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3795094 Sep 01 17:01:16.957714 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-693dca77-64a3-4686-876d-e3753268d793 None None] Network 50a57de3-5738-4399-9f1b-3d7d294c86dc requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:01:17.571040 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-060e17a8-eac9-423a-9779-00ce7f6c28e7 req-4424cd1b-d519-4cb3-b3fa-5ad4e1672d02 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:17.572536 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-060e17a8-eac9-423a-9779-00ce7f6c28e7 req-4424cd1b-d519-4cb3-b3fa-5ad4e1672d02 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0506992 Sep 01 17:01:17.609480 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-060e17a8-eac9-423a-9779-00ce7f6c28e7 req-d6f82998-7133-4471-91ca-8effa38b44d7 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310988 Sep 01 17:01:17.734336 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e05be18a-0060-4222-945e-28b824007738 req-96d58c20-0849-4656-b5e0-5270229fc0ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:17.736138 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e05be18a-0060-4222-945e-28b824007738 req-96d58c20-0849-4656-b5e0-5270229fc0ae service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18&tenant_id=af7d370157f84ca198eb86180115a76f HTTP/1.1" status: 200 len: 1096 time: 0.0739989 Sep 01 17:01:17.776038 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e433214-d460-40e3-94ea-516c10127aed req-fd1fbfa6-b7e0-498e-b090-c818b0cfc2e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:17.777663 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0e433214-d460-40e3-94ea-516c10127aed req-fd1fbfa6-b7e0-498e-b090-c818b0cfc2e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0503237 Sep 01 17:01:17.802329 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e05be18a-0060-4222-945e-28b824007738 req-641cfff3-8c41-4406-9eb8-47bc4742e4bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:17.804886 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e05be18a-0060-4222-945e-28b824007738 req-641cfff3-8c41-4406-9eb8-47bc4742e4bd service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 1096 time: 0.0438321 Sep 01 17:01:17.816847 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0e433214-d460-40e3-94ea-516c10127aed req-fce8f35f-09eb-4319-a336-60f27de83465 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0332851 Sep 01 17:01:17.907529 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e05be18a-0060-4222-945e-28b824007738 req-20fb3316-8394-4c66-8ada-93939f9def38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:17.908395 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489374ae-ccd5-4969-bee7-2020360b6fc3 req-729b60b9-a6af-414c-add5-24abf615358c tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:17.909042 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e05be18a-0060-4222-945e-28b824007738 req-20fb3316-8394-4c66-8ada-93939f9def38 service neutron] 10.222.0.69 "GET /v2.0/networks?id=2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 200 len: 917 time: 0.0941200 Sep 01 17:01:17.909936 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-489374ae-ccd5-4969-bee7-2020360b6fc3 req-729b60b9-a6af-414c-add5-24abf615358c tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 943 time: 0.0541294 Sep 01 17:01:17.948796 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-489374ae-ccd5-4969-bee7-2020360b6fc3 req-2d75f084-2988-4ccd-826d-5c87e71177d1 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320942 Sep 01 17:01:17.981613 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e05be18a-0060-4222-945e-28b824007738 req-7986c949-af04-48f6-a104-063a4eed8724 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb HTTP/1.1" status: 200 len: 998 time: 0.0607283 Sep 01 17:01:18.036762 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e05be18a-0060-4222-945e-28b824007738 req-9a984209-8523-42d4-963d-b54c39da67aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:18.038919 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e05be18a-0060-4222-945e-28b824007738 req-9a984209-8523-42d4-963d-b54c39da67aa service neutron] 10.222.0.69 "GET /v2.0/subnets?id=58fe425a-6b3e-47bd-b5c0-e68ea7782780 HTTP/1.1" status: 200 len: 855 time: 0.0481324 Sep 01 17:01:18.092801 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e05be18a-0060-4222-945e-28b824007738 req-5d19d2e0-05d8-40f6-aa62-583fead83aae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:18.094300 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e05be18a-0060-4222-945e-28b824007738 req-5d19d2e0-05d8-40f6-aa62-583fead83aae service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2f7bfe5e-0012-467f-ad7f-aea2467233ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0397937 Sep 01 17:01:18.188181 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e05be18a-0060-4222-945e-28b824007738 req-108b5856-da94-4a8a-abb4-c35f0c43afb2 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0797589 Sep 01 17:01:18.280248 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e05be18a-0060-4222-945e-28b824007738 req-09a51802-b37e-4dfc-900f-fb005c3f9fc0 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827558 Sep 01 17:01:18.335049 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 45822242-f0ab-4492-b049-73735203e788 details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:01:18.434502 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 45822242-f0ab-4492-b049-73735203e788, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=45822242-f0ab-4492-b049-73735203e788,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:18.446495 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': '45822242-f0ab-4492-b049-73735203e788', 'network_id': '8331b65a-166e-454c-a3c5-ed861dc82dfc', 'port_id': '45822242-f0ab-4492-b049-73735203e788', 'mac_address': 'fa:16:3e:6e:fb:42', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 525, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fd025a14-8839-4451-a03e-bc7daeb612d0', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:01:18.484204 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:18.497442 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 45822242-f0ab-4492-b049-73735203e788 {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:01:18.519084 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 45822242-f0ab-4492-b049-73735203e788, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=45822242-f0ab-4492-b049-73735203e788,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:18.524360 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:18.576471 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=45822242-f0ab-4492-b049-73735203e788,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:18.652941 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-0f55e935-87b9-47e6-b48e-3afbe7e51249 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:18.654482 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-0f55e935-87b9-47e6-b48e-3afbe7e51249 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/networks?id=50a57de3-5738-4399-9f1b-3d7d294c86dc HTTP/1.1" status: 200 len: 813 time: 0.1023781 Sep 01 17:01:18.676737 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-f623888a-1b65-412e-af5c-261b1a8a63be tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/quotas/7ddcba698dfe424a89ef6b0fa2e10ae6 HTTP/1.1" status: 200 len: 375 time: 0.0163782 Sep 01 17:01:18.708118 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-2f2d7031-9275-4c20-9ea3-e41e19fa9f1f tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=7ddcba698dfe424a89ef6b0fa2e10ae6&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0304561 Sep 01 17:01:18.808646 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3d36a58-d363-4ca0-8400-ac901c97a155 req-bdc2a0fa-9eae-49bc-8374-4dfefe0f24e8 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:18.810172 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a3d36a58-d363-4ca0-8400-ac901c97a155 req-bdc2a0fa-9eae-49bc-8374-4dfefe0f24e8 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.1224282 Sep 01 17:01:18.856872 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-3c2b23f0-4897-40ef-a46a-b3e131438b51 service neutron] 10.222.0.67 "GET /v2.0/networks/50a57de3-5738-4399-9f1b-3d7d294c86dc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1394210 Sep 01 17:01:18.882684 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['45822242-f0ab-4492-b049-73735203e788'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:01:18.931619 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a3d36a58-d363-4ca0-8400-ac901c97a155 req-fc3e0f3a-26b3-433e-8dbc-25e3d3976371 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1149387 Sep 01 17:01:19.048280 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-22dbe7ff-9f4e-4981-b6e8-b73de6408f14 service neutron] 10.222.0.67 "GET /v2.0/networks/50a57de3-5738-4399-9f1b-3d7d294c86dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1825986 Sep 01 17:01:19.150022 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40863d6a-0a12-4582-a467-fed24b1a9a27 req-719c1700-0e86-4b39-8bf2-bea244d7472f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:19.162052 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-40863d6a-0a12-4582-a467-fed24b1a9a27 req-719c1700-0e86-4b39-8bf2-bea244d7472f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0842979 Sep 01 17:01:19.225977 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-40863d6a-0a12-4582-a467-fed24b1a9a27 req-6ea18f8c-9888-4f92-88a6-a85f93fe086e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0573726 Sep 01 17:01:19.376367 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f53d33af-c1c3-4999-978b-f7f9cb4c3d5c req-f552704d-0de9-49a9-a2b6-866d1c11764e tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:19.378593 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f53d33af-c1c3-4999-978b-f7f9cb4c3d5c req-f552704d-0de9-49a9-a2b6-866d1c11764e tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 944 time: 0.0643897 Sep 01 17:01:19.427816 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f53d33af-c1c3-4999-978b-f7f9cb4c3d5c req-130ed207-39ec-417a-9ab7-d36b87a4d731 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415726 Sep 01 17:01:19.482089 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-dafdd690-6680-4a34-98f0-ba90ce96a9c4 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1200574755&fields=id&tenant_id=63c213b6da7541a0ba2b290c5e15fe03 HTTP/1.1" status: 200 len: 267 time: 0.0458515 Sep 01 17:01:19.591971 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a03ed2cb-46e9-4903-b1e9-f8f6aaeccddf req-2b40992c-e534-4603-bd01-fa67df71253b tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 210 time: 0.0786436 Sep 01 17:01:19.635145 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-220bd661-80e1-4790-b124-811b46f27ac8 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:19.636732 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-220bd661-80e1-4790-b124-811b46f27ac8 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 811 time: 0.1538486 Sep 01 17:01:19.660836 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-cbc85e39-fb27-4e4e-a796-0a09f47e519d tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/quotas/63c213b6da7541a0ba2b290c5e15fe03 HTTP/1.1" status: 200 len: 375 time: 0.0173299 Sep 01 17:01:19.713642 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-705b5130-de59-49df-9839-7e5e39f40b4d tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0516109 Sep 01 17:01:19.830537 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-6a9fea29-6198-4220-becd-2f44580f0133 service neutron] 10.222.0.67 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1036308 Sep 01 17:01:19.928508 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-317c8a62-7fb7-4c22-8b5c-d2f8f706f8b6 service neutron] 10.222.0.67 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0899088 Sep 01 17:01:20.069749 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d924378e-77ae-42b3-8933-5bdaf6b40d9b req-546cd180-6ed3-49ed-8db0-2a97590bb813 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:20.071606 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d924378e-77ae-42b3-8933-5bdaf6b40d9b req-546cd180-6ed3-49ed-8db0-2a97590bb813 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0559609 Sep 01 17:01:20.111611 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d924378e-77ae-42b3-8933-5bdaf6b40d9b req-97a5cbe9-f9ae-479d-b9ee-e7f0de7c56c4 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0339966 Sep 01 17:01:20.251974 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cc7b2ca1-0c46-40e1-96ee-0392f8b160d6 req-a562f121-398c-4836-a971-41fa58b415fc tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0309746 Sep 01 17:01:20.366695 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 45822242-f0ab-4492-b049-73735203e788 up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:01:20.419323 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438a499d-ef52-465f-820a-0f026672c80f req-6f1d2675-ffde-4c43-a044-0995c44a74c3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:20.420390 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-438a499d-ef52-465f-820a-0f026672c80f req-6f1d2675-ffde-4c43-a044-0995c44a74c3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0602837 Sep 01 17:01:20.432157 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port 45822242-f0ab-4492-b049-73735203e788 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:01:20.436470 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port 45822242-f0ab-4492-b049-73735203e788 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:01:20.436784 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:20.506995 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-438a499d-ef52-465f-820a-0f026672c80f req-51f967d1-dd8e-4156-8350-f8dc71b9db29 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0717149 Sep 01 17:01:20.560260 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:20.586032 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c48c7ff9-8c18-4eae-b554-12334f7fa2e6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45822242-f0ab-4492-b049-73735203e788'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:20.588948 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f1122d4-3575-4d37-a9a4-be15bc5c9413" -d '{"events": [{"server_uuid": "c48c7ff9-8c18-4eae-b554-12334f7fa2e6", "name": "network-vif-plugged", "status": "completed", "tag": "45822242-f0ab-4492-b049-73735203e788"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:20.604852 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 45822242-f0ab-4492-b049-73735203e788, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=45822242-f0ab-4492-b049-73735203e788,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:20.608049 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccdcb5a7-e32c-4ad9-90da-ba91a9842efb req-9f6f4119-c835-42e3-b968-fb59177e1e91 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:20.609730 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:20.617726 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ccdcb5a7-e32c-4ad9-90da-ba91a9842efb req-9f6f4119-c835-42e3-b968-fb59177e1e91 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 944 time: 0.1064398 Sep 01 17:01:20.660119 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-762ad8a7-f449-4395-ab48-22608f538e90 x-openstack-request-id: req-762ad8a7-f449-4395-ab48-22608f538e90 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:20.660462 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c48c7ff9-8c18-4eae-b554-12334f7fa2e6", "name": "network-vif-plugged", "status": "completed", "tag": "45822242-f0ab-4492-b049-73735203e788", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:20.665477 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-762ad8a7-f449-4395-ab48-22608f538e90 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:20.665477 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c48c7ff9-8c18-4eae-b554-12334f7fa2e6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45822242-f0ab-4492-b049-73735203e788', 'code': 200} Sep 01 17:01:20.667817 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ccdcb5a7-e32c-4ad9-90da-ba91a9842efb req-619ca10c-05eb-4e1c-a1b7-d34228917e38 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436091 Sep 01 17:01:20.682776 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=45822242-f0ab-4492-b049-73735203e788,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:20.756761 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-455ea110-7305-4dd4-b4ec-b3792528df86 req-dc7a19d6-0f49-4c11-af45-66ad1d92f76a tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 210 time: 0.0266311 Sep 01 17:01:21.244606 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2df5f497-ff6d-487d-b88c-03acd061da04 req-e23c5d18-d1da-486c-8fc6-7a36e350e147 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:21.246226 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2df5f497-ff6d-487d-b88c-03acd061da04 req-e23c5d18-d1da-486c-8fc6-7a36e350e147 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0623899 Sep 01 17:01:21.268936 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-16d1f466-fa3e-405a-836d-63f5638dbb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:21.305510 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2df5f497-ff6d-487d-b88c-03acd061da04 req-3dde9526-bdc5-40b5-8a9d-d051f8652c3b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482395 Sep 01 17:01:21.351759 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9e173a8f-c303-4a62-aaa7-e2addca5d92b req-f4ae4021-3015-437e-8eee-c473aaf910bd tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0256896 Sep 01 17:01:21.639297 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aa1b3a7-e400-45cc-8246-358018e9320d req-29bc3627-e050-4601-97f6-e6a0b9841896 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:21.640777 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3aa1b3a7-e400-45cc-8246-358018e9320d req-29bc3627-e050-4601-97f6-e6a0b9841896 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0485311 Sep 01 17:01:21.682430 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3aa1b3a7-e400-45cc-8246-358018e9320d req-551ef500-5a28-48a3-83db-bc4098273f12 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0340166 Sep 01 17:01:21.779228 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-269490b8-c4da-41c0-b296-673376783022 req-39feaecf-a910-42c9-9288-536ede59de3b tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:21.780832 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-269490b8-c4da-41c0-b296-673376783022 req-39feaecf-a910-42c9-9288-536ede59de3b tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0537202 Sep 01 17:01:21.826734 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-269490b8-c4da-41c0-b296-673376783022 req-fd6c98bb-62c2-4d0d-9ddf-733011507702 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397778 Sep 01 17:01:21.853590 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1166eea4-bc13-4937-ace5-fdc1de0ab5f7 req-ff068ee8-d00d-4148-ac91-3e35d13848f0 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 210 time: 0.0259423 Sep 01 17:01:22.452004 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-07c8002e-14ca-4015-aaa5-39b0df5e510d req-765208fb-2c92-4138-831c-85f42e1a19e1 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0303748 Sep 01 17:01:22.462875 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c437481f-8154-4825-8d3a-54b1a45028d1 req-7767c805-4da2-42fc-93bf-0a36917bedc6 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:22.464473 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c437481f-8154-4825-8d3a-54b1a45028d1 req-7767c805-4da2-42fc-93bf-0a36917bedc6 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0785961 Sep 01 17:01:22.505687 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c437481f-8154-4825-8d3a-54b1a45028d1 req-a2ceb769-1fa2-4e97-a4f6-2c0099201587 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0351350 Sep 01 17:01:22.804283 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca8db1a7-54e9-4f21-b7a7-b9db4daa7c82 req-9d305c8e-b5ea-418a-af49-d53823a9a2dd tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:22.805795 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ca8db1a7-54e9-4f21-b7a7-b9db4daa7c82 req-9d305c8e-b5ea-418a-af49-d53823a9a2dd tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0514219 Sep 01 17:01:22.842774 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ca8db1a7-54e9-4f21-b7a7-b9db4daa7c82 req-51ae9f54-b28c-4a2f-a6fd-0e00a8a9948f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0309858 Sep 01 17:01:22.966834 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-934a0a2f-c736-4402-95cc-71714e9b4b41 req-0d961866-f355-4700-bb80-9f79e43ab72d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 210 time: 0.0390694 Sep 01 17:01:22.976284 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b77dcb-ff35-4697-a981-b54cbcecc39c req-f07d0a53-ae54-4971-a0ba-ff7102d959a9 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:22.978099 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-12b77dcb-ff35-4697-a981-b54cbcecc39c req-f07d0a53-ae54-4971-a0ba-ff7102d959a9 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0806940 Sep 01 17:01:23.021283 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-12b77dcb-ff35-4697-a981-b54cbcecc39c req-73795f93-cb5f-4009-a9f3-1bf54e634be2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0348017 Sep 01 17:01:23.554875 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f79abe67-01b1-41fa-9056-a3ae81e557db req-212b52c9-b07e-433a-ab38-d59a4106435c tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0368562 Sep 01 17:01:23.646451 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48178a2f-647d-4ee4-aabd-5ed60e8d217e req-89c1a80f-8a80-4425-b716-096e63c5f125 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:23.648104 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-48178a2f-647d-4ee4-aabd-5ed60e8d217e req-89c1a80f-8a80-4425-b716-096e63c5f125 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0514636 Sep 01 17:01:23.693011 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-48178a2f-647d-4ee4-aabd-5ed60e8d217e req-5c616dd1-f0ec-4448-ac02-d14e1d3ac55a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386682 Sep 01 17:01:23.760238 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:23.769859 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7d6d1457-ed8f-4637-95fb-c378de62cf8b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:23.967356 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a855ed5-0abe-485b-9e20-f8bc33c2433f req-d2375b0a-5229-4528-9572-97c0629e5134 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:23.968784 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0a855ed5-0abe-485b-9e20-f8bc33c2433f req-d2375b0a-5229-4528-9572-97c0629e5134 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0496578 Sep 01 17:01:24.011016 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0a855ed5-0abe-485b-9e20-f8bc33c2433f req-e627764d-fd60-42ae-b47d-63befbd87963 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0355525 Sep 01 17:01:24.076883 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d52780c9-4277-400d-9c00-7ca08c891f01 req-318ea0ec-c75e-4437-8c21-6e61a87f60d3 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 210 time: 0.0330274 Sep 01 17:01:24.148424 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a7f7d0-6108-4702-9dba-6aaa985a1139 req-e3167b6c-ab14-4938-aba5-e5b56d7228a4 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:24.149953 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-88a7f7d0-6108-4702-9dba-6aaa985a1139 req-e3167b6c-ab14-4938-aba5-e5b56d7228a4 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0509439 Sep 01 17:01:24.189354 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-88a7f7d0-6108-4702-9dba-6aaa985a1139 req-313a8a79-3538-4001-99f7-4b07a9ae7cfa tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0330567 Sep 01 17:01:24.654427 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b583c2b5-391a-44f5-8191-05b680712dbd req-af1d5db8-f461-4d86-b0f0-80a4a71d4da4 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0261235 Sep 01 17:01:24.817708 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfe01a6-13ea-4ab5-a872-9305cb74103e req-f3e323ef-84ba-42c9-aef5-a01ead651d74 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:24.819211 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2bfe01a6-13ea-4ab5-a872-9305cb74103e req-f3e323ef-84ba-42c9-aef5-a01ead651d74 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0505741 Sep 01 17:01:24.857695 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2bfe01a6-13ea-4ab5-a872-9305cb74103e req-4688f15c-c714-43d8-9e6e-17099cce37c3 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324543 Sep 01 17:01:24.894276 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:25.184664 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e139e91-01b6-448f-80e6-f0807d12c835 req-250c4c42-8b76-4fe5-a456-fed203936597 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:25.186380 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5e139e91-01b6-448f-80e6-f0807d12c835 req-250c4c42-8b76-4fe5-a456-fed203936597 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0954676 Sep 01 17:01:25.188449 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3b66f7a1-bef9-452d-b60f-0528f1c32c39 req-4e8c1898-60b0-44b6-bdee-080c3679110b tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 210 time: 0.0379984 Sep 01 17:01:25.229051 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5e139e91-01b6-448f-80e6-f0807d12c835 req-d1fb4f39-24eb-41f7-81a6-2e0f5b94dc60 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0366731 Sep 01 17:01:25.309891 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-255ef3c6-dcfe-4091-ab16-2f524ebb8f45 req-0fff3a25-4a85-43c3-8f60-4c86509bff06 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:25.311374 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-255ef3c6-dcfe-4091-ab16-2f524ebb8f45 req-0fff3a25-4a85-43c3-8f60-4c86509bff06 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0510588 Sep 01 17:01:25.349000 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-255ef3c6-dcfe-4091-ab16-2f524ebb8f45 req-6294c120-7b5c-4f20-a22b-e5024b76c92b tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314198 Sep 01 17:01:25.752569 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e996704f-6e58-4a21-a740-9d8b2b37cb12 req-a83ce5bf-22d9-41dd-b473-b0b4bc886ece tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0310984 Sep 01 17:01:25.977301 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d8d59d9-78bf-4d92-aee9-9f49d4ca5a6e req-b5cb196b-e3af-48ec-8fd7-e13312a6b318 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:25.979256 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3d8d59d9-78bf-4d92-aee9-9f49d4ca5a6e req-b5cb196b-e3af-48ec-8fd7-e13312a6b318 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0508335 Sep 01 17:01:26.016586 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3d8d59d9-78bf-4d92-aee9-9f49d4ca5a6e req-3a4a690b-b657-4700-a41b-6daef25340b3 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314529 Sep 01 17:01:26.291798 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cd4c398d-25e7-40c9-83d4-e138e6138e15 req-5948ab27-106d-4f8e-b031-bfba213bfa9e tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 210 time: 0.0305135 Sep 01 17:01:26.363805 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21509963-dd90-43d2-8d33-c9807f1527be req-9e4b7ce8-099a-4452-a1b1-6f0423e11b22 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:26.364940 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-21509963-dd90-43d2-8d33-c9807f1527be req-9e4b7ce8-099a-4452-a1b1-6f0423e11b22 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0527904 Sep 01 17:01:26.404960 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-21509963-dd90-43d2-8d33-c9807f1527be req-bd70880c-fa14-482d-bbc2-b3ad29f211ac tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0335383 Sep 01 17:01:26.466166 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:26.475778 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-824f6483-0d6e-4612-b297-b89fadbf1385 req-99758ec9-7136-4a68-bd59-5744882b52ad tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:26.477254 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-824f6483-0d6e-4612-b297-b89fadbf1385 req-99758ec9-7136-4a68-bd59-5744882b52ad tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0566976 Sep 01 17:01:26.516459 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-824f6483-0d6e-4612-b297-b89fadbf1385 req-c63dd186-6d66-4b84-bb93-db0133a94ac2 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331163 Sep 01 17:01:26.543599 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:26.851575 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4ec5e47a-1ab5-436b-bba9-b4d8526c8556 req-e149eb22-df58-4342-ac8d-dbb3574b8c55 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0264773 Sep 01 17:01:27.137409 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32e20525-8577-43c7-bd69-69f77a09aab2 req-311ccc66-4bf1-4ec6-8a56-8d870c3c10a7 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:27.138931 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-32e20525-8577-43c7-bd69-69f77a09aab2 req-311ccc66-4bf1-4ec6-8a56-8d870c3c10a7 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0513802 Sep 01 17:01:27.178635 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-32e20525-8577-43c7-bd69-69f77a09aab2 req-a8830b82-a395-4322-9891-01c13d06b1b0 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0337167 Sep 01 17:01:27.387443 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-acba7b4d-cc90-4c89-88c9-aaa1e1e92319 req-cb7cd9fd-90de-45f8-8f33-0aa264f88055 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 210 time: 0.0314643 Sep 01 17:01:27.530500 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ca3095-a274-4680-8b6e-cbfdfa0b1d27 req-5d3dc04e-0f27-452a-bfb0-2bdb5c394651 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:27.532176 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a8ca3095-a274-4680-8b6e-cbfdfa0b1d27 req-5d3dc04e-0f27-452a-bfb0-2bdb5c394651 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0513718 Sep 01 17:01:27.574072 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a8ca3095-a274-4680-8b6e-cbfdfa0b1d27 req-fad01ab2-672b-40de-8b60-3e3b345bfefa tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0342834 Sep 01 17:01:27.638676 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76bb1b0c-6df2-4212-9914-9e681c56cac3 req-15ee1480-a743-4b5e-9c94-d4bbc3e07535 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:27.640363 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-76bb1b0c-6df2-4212-9914-9e681c56cac3 req-15ee1480-a743-4b5e-9c94-d4bbc3e07535 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0480533 Sep 01 17:01:27.680319 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-76bb1b0c-6df2-4212-9914-9e681c56cac3 req-9a491ea1-d241-4ea7-bd5d-7ce23e85eb5f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336409 Sep 01 17:01:27.954185 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5b2f9dea-8324-4184-825f-5e3c22becff1 req-f8b5b8d0-d48a-4d1e-9a31-65e497f15a16 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0256848 Sep 01 17:01:28.314432 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c57db46-3084-4e7d-ad2d-2db8cf849376 req-d5f2fc5f-b443-43f7-b5af-ace4511ffbc8 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:28.316133 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6c57db46-3084-4e7d-ad2d-2db8cf849376 req-d5f2fc5f-b443-43f7-b5af-ace4511ffbc8 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0540972 Sep 01 17:01:28.354666 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6c57db46-3084-4e7d-ad2d-2db8cf849376 req-b3856dc1-d0c8-4428-87bf-f219824cf474 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321679 Sep 01 17:01:28.482342 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4ecd0a9c-a7e6-4821-bc71-9f01701efeda req-1ca98e21-3e7b-4cbc-826f-cf8601f4a4cb tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 210 time: 0.0290256 Sep 01 17:01:28.698953 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef98064f-9c4f-403e-9c40-9d2639895c1f req-10f63a03-3d34-4e43-bee6-9cd9210a7f3c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:28.700441 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ef98064f-9c4f-403e-9c40-9d2639895c1f req-10f63a03-3d34-4e43-bee6-9cd9210a7f3c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0537000 Sep 01 17:01:28.754953 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ef98064f-9c4f-403e-9c40-9d2639895c1f req-b9d2efa8-cc40-4169-ad46-bab679bed5f1 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482864 Sep 01 17:01:28.814558 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95e1a6b6-e04f-4d37-bcaa-f08ea56728f9 req-f360af00-e8ff-417a-9080-0a3e1cca58fb tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:28.816459 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-95e1a6b6-e04f-4d37-bcaa-f08ea56728f9 req-f360af00-e8ff-417a-9080-0a3e1cca58fb tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0581982 Sep 01 17:01:28.856456 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-95e1a6b6-e04f-4d37-bcaa-f08ea56728f9 req-e7d90c37-7870-47b2-ad33-d2900ef00da7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331328 Sep 01 17:01:29.050212 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cb943c4c-674a-4e5c-bb1d-ebdb7a9e23a2 req-2d52bbbb-907d-4606-8ba3-927bd8edc221 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0268786 Sep 01 17:01:29.473461 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f573937-632b-4238-9ac2-c69375e03cd6 req-ae1163d5-9219-401d-8eda-2535b8091b65 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:29.476332 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8f573937-632b-4238-9ac2-c69375e03cd6 req-ae1163d5-9219-401d-8eda-2535b8091b65 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0536025 Sep 01 17:01:29.517569 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8f573937-632b-4238-9ac2-c69375e03cd6 req-56613b05-b87f-4ce4-be7f-b8c56a1b5c81 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0352738 Sep 01 17:01:29.596065 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1bbc5600-0853-4da8-b755-95da06104e53 req-6d834990-66b2-47c7-b808-2e6de8153cd6 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 210 time: 0.0350738 Sep 01 17:01:29.892229 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-909b3a17-01c8-428f-a99b-aeb9d6865013 req-51e58250-f463-4e9e-972f-90fd793a63bb tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:29.893775 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-909b3a17-01c8-428f-a99b-aeb9d6865013 req-51e58250-f463-4e9e-972f-90fd793a63bb tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0519152 Sep 01 17:01:29.945085 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-909b3a17-01c8-428f-a99b-aeb9d6865013 req-450c6259-68aa-4442-813f-28173bbbf686 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449774 Sep 01 17:01:29.982457 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1377506c-344e-496f-96e5-fc181257a1b2 req-74b75dfe-7966-4594-99d1-6a3b39e1eeee tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:29.984014 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1377506c-344e-496f-96e5-fc181257a1b2 req-74b75dfe-7966-4594-99d1-6a3b39e1eeee tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0544717 Sep 01 17:01:30.026452 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1377506c-344e-496f-96e5-fc181257a1b2 req-2bf03d4c-5b80-4fa5-9da7-8d9201f9200b tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0361578 Sep 01 17:01:30.153674 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f3c190b5-4d00-4a38-9253-5ccf99c010e9 req-6ae59f76-6d4b-4025-9906-180cd9cef915 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0309043 Sep 01 17:01:30.641663 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6acbc5c8-f450-474d-aa9e-bbfc449a256b req-0d110765-6dca-4d5d-a004-5d935104c274 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:30.643469 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6acbc5c8-f450-474d-aa9e-bbfc449a256b req-0d110765-6dca-4d5d-a004-5d935104c274 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0553033 Sep 01 17:01:30.695415 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f11fd6d4-c3a2-48ec-9dfb-fa83bc3ff79d req-8883636c-1f84-402f-b8ce-ab9674a1c526 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 210 time: 0.0288732 Sep 01 17:01:30.707901 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6acbc5c8-f450-474d-aa9e-bbfc449a256b req-eb4c7294-df81-43cd-a3ee-930b45239a39 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583794 Sep 01 17:01:31.066322 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a7c5c6-7513-48b9-99f3-b5409423386a req-52303d5f-99e5-4612-ad65-90397cac1a25 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:31.067789 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-77a7c5c6-7513-48b9-99f3-b5409423386a req-52303d5f-99e5-4612-ad65-90397cac1a25 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0508933 Sep 01 17:01:31.116425 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-77a7c5c6-7513-48b9-99f3-b5409423386a req-eb0bf58f-bb07-400d-9985-80cf36da1903 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426564 Sep 01 17:01:31.379680 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1fb032c8-c6a9-426e-b3d9-bcddeb7b04f4 req-6df7e362-f7fc-4cf6-a9af-de8c64bd445a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0277948 Sep 01 17:01:31.395422 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8bb5828-e4e9-42b5-9b8d-0f643e1a4498 req-924a9ad0-78c4-45a7-943a-fd07aa9cd86e tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:31.397499 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c8bb5828-e4e9-42b5-9b8d-0f643e1a4498 req-924a9ad0-78c4-45a7-943a-fd07aa9cd86e tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.3038514 Sep 01 17:01:31.433786 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c8bb5828-e4e9-42b5-9b8d-0f643e1a4498 req-0c604b71-cafa-4188-9a14-8116c45a68aa tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0301886 Sep 01 17:01:31.743841 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-af7da6aa-b06f-4551-9270-cc8da7d27ce3 req-a14c064b-be94-4460-8011-f3012d03f44a service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0565209 Sep 01 17:01:31.886065 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-39a5ec58-7976-420a-a295-e7d83376f5fa req-863b3d45-b793-4eae-a6a9-8f1f99266f4e tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 210 time: 0.0954528 Sep 01 17:01:31.920424 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c66f220-880a-4995-96f8-252ed1c0e357 req-9a4cea34-4a0d-45cb-88d2-3351ecd6a3ad tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:31.922477 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1c66f220-880a-4995-96f8-252ed1c0e357 req-9a4cea34-4a0d-45cb-88d2-3351ecd6a3ad tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.1241672 Sep 01 17:01:31.931262 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af7da6aa-b06f-4551-9270-cc8da7d27ce3 req-15e89fec-f0c9-46b0-b3a4-46cefb138d0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:31.933231 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-af7da6aa-b06f-4551-9270-cc8da7d27ce3 req-15e89fec-f0c9-46b0-b3a4-46cefb138d0f service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=4199ca0b18374af7856c19238fc2fea1&device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 1098 time: 0.1009622 Sep 01 17:01:31.940986 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9817eb4c-286d-4a68-9754-7b285788c4d0 req-31b25d0a-fce1-4826-b487-966d8722073b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:31.943757 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9817eb4c-286d-4a68-9754-7b285788c4d0 req-31b25d0a-fce1-4826-b487-966d8722073b service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 1098 time: 0.0713456 Sep 01 17:01:31.975210 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1c66f220-880a-4995-96f8-252ed1c0e357 req-53de334d-8259-428d-b841-89122de74bed tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436952 Sep 01 17:01:32.037213 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9817eb4c-286d-4a68-9754-7b285788c4d0 req-cc561f5c-fd41-4164-8aeb-39f1b193fa2c service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836518 Sep 01 17:01:32.076403 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af7da6aa-b06f-4551-9270-cc8da7d27ce3 req-bb0a0fb8-8abe-4711-a119-77b0bfb3fa34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:32.077961 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-af7da6aa-b06f-4551-9270-cc8da7d27ce3 req-bb0a0fb8-8abe-4711-a119-77b0bfb3fa34 service neutron] 10.222.0.69 "GET /v2.0/networks?id=63606bb0-66bd-46d6-ba6c-55c6da830865 HTTP/1.1" status: 200 len: 920 time: 0.1166363 Sep 01 17:01:32.237080 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3869a2f0-2899-47e5-bc21-5c83511ba487 req-0369ef78-670a-4a6a-ae50-1a5de609a359 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:32.238454 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3869a2f0-2899-47e5-bc21-5c83511ba487 req-0369ef78-670a-4a6a-ae50-1a5de609a359 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0475676 Sep 01 17:01:32.279519 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3869a2f0-2899-47e5-bc21-5c83511ba487 req-7a27b89c-61db-41ac-8a51-a957829e6cea tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0352087 Sep 01 17:01:32.298152 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-af7da6aa-b06f-4551-9270-cc8da7d27ce3 req-6d49dcd3-0ed3-4d80-8dad-f09ece8550da service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=5e47292e-406f-4ed9-9215-3dcfba5fcde4 HTTP/1.1" status: 200 len: 217 time: 0.0399427 Sep 01 17:01:32.359556 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af7da6aa-b06f-4551-9270-cc8da7d27ce3 req-1d5e66a7-dcd5-4d1c-a746-30709a71988b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:32.361027 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-af7da6aa-b06f-4551-9270-cc8da7d27ce3 req-1d5e66a7-dcd5-4d1c-a746-30709a71988b service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd331d5b-40b1-4163-8537-7af4e56f1efd HTTP/1.1" status: 200 len: 859 time: 0.0459106 Sep 01 17:01:32.408191 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-af7da6aa-b06f-4551-9270-cc8da7d27ce3 req-22ac2a80-7430-443e-80ac-457741df2dc8 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=63606bb0-66bd-46d6-ba6c-55c6da830865&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0251551 Sep 01 17:01:32.476862 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-36f9cf8c-3667-428b-a341-f9df7a61bbf8 req-f327103c-1588-44f2-a222-a34eb25d6511 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0284512 Sep 01 17:01:32.507849 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-af7da6aa-b06f-4551-9270-cc8da7d27ce3 req-d5b19478-11d4-4148-a505-5a13f3cc4f81 service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887122 Sep 01 17:01:32.560135 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b66e3240-da0d-457d-8538-e1d3845af156 req-37ce72d6-7edd-4a43-9260-99d965ecb312 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:32.561608 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b66e3240-da0d-457d-8538-e1d3845af156 req-37ce72d6-7edd-4a43-9260-99d965ecb312 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0500278 Sep 01 17:01:32.598987 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b66e3240-da0d-457d-8538-e1d3845af156 req-b822d6cc-3aa4-46ac-bd94-cfec94337e26 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312874 Sep 01 17:01:32.602975 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-af7da6aa-b06f-4551-9270-cc8da7d27ce3 req-dae1b07d-fd2a-4059-bd84-b175f5b6ae4a service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826154 Sep 01 17:01:32.992889 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7b2dc380-13f6-4db3-a01e-fbf1722c4521 req-ce681f99-55fa-452a-8de0-0ad784d98563 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 210 time: 0.0282087 Sep 01 17:01:33.001260 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-7cbfa99d-4fd4-49cf-89c2-1c9ddde964f8 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:33.002868 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-7cbfa99d-4fd4-49cf-89c2-1c9ddde964f8 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.69 "GET /v2.0/networks?id=50a57de3-5738-4399-9f1b-3d7d294c86dc HTTP/1.1" status: 200 len: 813 time: 0.1181381 Sep 01 17:01:33.019785 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Request body: {'port': {'device_id': '0665ed54-9cf9-4fb0-8ac8-e671808548d1', 'network_id': '50a57de3-5738-4399-9f1b-3d7d294c86dc', 'admin_state_up': True, 'tenant_id': '7ddcba698dfe424a89ef6b0fa2e10ae6'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:33.095066 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96cad132-7537-4ba5-91ef-a757cf7c937a req-cd28df79-0164-4b2b-9020-03415c35ce66 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:33.096556 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-96cad132-7537-4ba5-91ef-a757cf7c937a req-cd28df79-0164-4b2b-9020-03415c35ce66 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0499029 Sep 01 17:01:33.132726 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Made reservation on behalf of 7ddcba698dfe424a89ef6b0fa2e10ae6 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:01:33.136192 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:33.136435 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-96cad132-7537-4ba5-91ef-a757cf7c937a req-213bba1f-4f3e-4def-8a02-2b2f51e3fe1b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0335000 Sep 01 17:01:33.266534 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Allocated IP 172.20.0.5 (50a57de3-5738-4399-9f1b-3d7d294c86dc/666c0d30-db52-4561-9b93-97a824a51a0d/7d758c28-5119-4575-8aae-fa9c017e56ad) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:01:33.409729 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbbd15fa-4289-4d95-ac0e-dfb93820aa85 req-d2d3494b-dd47-4d30-8e1c-caab1a21128c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:33.411327 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bbbd15fa-4289-4d95-ac0e-dfb93820aa85 req-d2d3494b-dd47-4d30-8e1c-caab1a21128c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0528953 Sep 01 17:01:33.457943 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bbbd15fa-4289-4d95-ac0e-dfb93820aa85 req-2940d35b-fde2-4b37-8c11-5e9208457787 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397415 Sep 01 17:01:33.530789 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:33.548320 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-51488f8b-10eb-4cd0-884b-207700462bd8 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:33.549887 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-51488f8b-10eb-4cd0-884b-207700462bd8 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 811 time: 0.1762819 Sep 01 17:01:33.592526 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:01:33.613774 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-330d868c-4c0a-4657-8315-e2e2e6fcbfee req-753a837d-de02-48fe-b45e-dd642c08f2d2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0263772 Sep 01 17:01:33.627538 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:33.641868 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-e2dafb6e-12fc-4511-b60b-78d8396723fe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=63c213b6da7541a0ba2b290c5e15fe03 HTTP/1.1" status: 200 len: 380 time: 0.0710795 Sep 01 17:01:33.674772 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-b55637c0-25a8-434e-9356-645b77f16278 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Request body: {'port': {'device_id': 'f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'admin_state_up': True, 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'security_groups': ['8ded1df8-6989-4db0-876f-79e2a5cfe05e']}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:33.733507 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a58d2d-fb49-4bd8-8652-e099d477fa94 req-a7e52add-a5b3-48cb-886d-0de9d8792c27 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:33.735230 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-69a58d2d-fb49-4bd8-8652-e099d477fa94 req-a7e52add-a5b3-48cb-886d-0de9d8792c27 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0592041 Sep 01 17:01:33.765746 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Network 50a57de3-5738-4399-9f1b-3d7d294c86dc is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:01:33.770868 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:01:33.776327 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Pushing event updated for resources: {'Port': ['ID=7d758c28-5119-4575-8aae-fa9c017e56ad,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:33.779252 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:01:33.780419 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-69a58d2d-fb49-4bd8-8652-e099d477fa94 req-007c11bc-a47c-467d-a8b1-1d6027d70bd6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390956 Sep 01 17:01:33.816718 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:33.817075 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:33.817432 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:33.817784 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:33.818870 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:33.819477 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:33.819815 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:33.820148 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:33.820640 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:33.820971 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:33.821301 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:33.821660 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:33.853978 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54faeb4f-3851-4c64-bdd9-115868322e36 req-b8435cd2-7178-4b83-8928-50866cb6d9ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:33.855527 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-54faeb4f-3851-4c64-bdd9-115868322e36 req-b8435cd2-7178-4b83-8928-50866cb6d9ed service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 1098 time: 0.1849210 Sep 01 17:01:33.883163 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:33.883802 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:33.918426 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-f4b61fde-cae2-414c-a029-0e4a044e6b20 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9027119 Sep 01 17:01:33.940507 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Request body: {'port': {'device_id': '0665ed54-9cf9-4fb0-8ac8-e671808548d1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:33.948366 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-b55637c0-25a8-434e-9356-645b77f16278 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Made reservation on behalf of 63c213b6da7541a0ba2b290c5e15fe03 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:01:33.951919 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-b55637c0-25a8-434e-9356-645b77f16278 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:33.970520 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-54faeb4f-3851-4c64-bdd9-115868322e36 req-c9a9584a-b8dd-46d0-8bfb-202f4330eb82 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0825191 Sep 01 17:01:34.106739 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:34.129470 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856ea977-5eab-47eb-8c15-f6563c163db0 req-5e7db121-55bd-4edb-8dea-03ae36e5a276 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:34.131314 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-856ea977-5eab-47eb-8c15-f6563c163db0 req-5e7db121-55bd-4edb-8dea-03ae36e5a276 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 931 time: 0.0503118 Sep 01 17:01:34.171349 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-856ea977-5eab-47eb-8c15-f6563c163db0 req-2b6659da-4b81-493c-908b-d1cb52aad5ae tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332386 Sep 01 17:01:34.274291 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-b55637c0-25a8-434e-9356-645b77f16278 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Allocated IP 172.20.0.6 (35c995f2-96ec-4a35-9f59-05221a09df3f/ab89c120-a892-4afa-a645-bf3caf534f7c/b4fb0a19-69a3-49ac-877e-9d08996f0c77) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:01:34.283110 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8885150-c729-45cc-96ff-943261f049df req-46e58dcd-888c-4cb5-bf64-d483651e7d3c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:34.284758 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c8885150-c729-45cc-96ff-943261f049df req-46e58dcd-888c-4cb5-bf64-d483651e7d3c tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0578671 Sep 01 17:01:34.334671 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c8885150-c729-45cc-96ff-943261f049df req-cc6b727d-505b-4b91-9922-f4d3f57c28d7 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411527 Sep 01 17:01:34.592555 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c832559-b2b0-41d7-a7ff-e1539cf75266 req-0f6a82b4-ec97-46b1-98c3-1e12502b6862 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:34.600590 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5c832559-b2b0-41d7-a7ff-e1539cf75266 req-0f6a82b4-ec97-46b1-98c3-1e12502b6862 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0572438 Sep 01 17:01:34.646681 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5c832559-b2b0-41d7-a7ff-e1539cf75266 req-4e0c27c1-3e97-4c6c-ac7b-3fbbaa322f25 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444584 Sep 01 17:01:34.713141 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-b55637c0-25a8-434e-9356-645b77f16278 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:34.721251 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c7e64061-383e-422f-a6c3-9c579b627be9 req-787ddbab-ea6d-4d53-ac7c-30d795636722 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0297670 Sep 01 17:01:34.753107 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-b55637c0-25a8-434e-9356-645b77f16278 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Transition to ACTIVE for port object b4fb0a19-69a3-49ac-877e-9d08996f0c77 will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:01:34.758355 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7d758c28-5119-4575-8aae-fa9c017e56ad {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:01:34.767280 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:34.788605 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Transition to ACTIVE for port object 7d758c28-5119-4575-8aae-fa9c017e56ad will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:01:34.794969 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:34.842994 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-b55637c0-25a8-434e-9356-645b77f16278 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:34.860765 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Pushing event updated for resources: {'Port': ['ID=7d758c28-5119-4575-8aae-fa9c017e56ad,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:34.887793 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-b55637c0-25a8-434e-9356-645b77f16278 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Network 35c995f2-96ec-4a35-9f59-05221a09df3f is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:01:34.926860 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-b55637c0-25a8-434e-9356-645b77f16278 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:01:34.932460 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-b55637c0-25a8-434e-9356-645b77f16278 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:01:34.981179 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b55637c0-25a8-434e-9356-645b77f16278 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'Port': ['ID=b4fb0a19-69a3-49ac-877e-9d08996f0c77,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:35.017601 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-b55637c0-25a8-434e-9356-645b77f16278 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:35.018244 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-b55637c0-25a8-434e-9356-645b77f16278 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:35.020861 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Attempting to bind port 7d758c28-5119-4575-8aae-fa9c017e56ad on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:01:35.021894 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Attempting to bind port 7d758c28-5119-4575-8aae-fa9c017e56ad by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': '908c9756-53a1-4c99-846c-262c66bbb074', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '50a57de3-5738-4399-9f1b-3d7d294c86dc'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:01:35.022398 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Attempting to bind port 7d758c28-5119-4575-8aae-fa9c017e56ad on network 50a57de3-5738-4399-9f1b-3d7d294c86dc {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:01:35.032049 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Port 7d758c28-5119-4575-8aae-fa9c017e56ad on network 50a57de3-5738-4399-9f1b-3d7d294c86dc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:01:35.032412 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Attempting to bind port 7d758c28-5119-4575-8aae-fa9c017e56ad on network 50a57de3-5738-4399-9f1b-3d7d294c86dc {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:01:35.039211 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 1, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:01:35.039554 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Checking segment: {'id': '908c9756-53a1-4c99-846c-262c66bbb074', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '50a57de3-5738-4399-9f1b-3d7d294c86dc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:01:35.039937 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Bound using segment: {'id': '908c9756-53a1-4c99-846c-262c66bbb074', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '50a57de3-5738-4399-9f1b-3d7d294c86dc'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:01:35.040377 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Bound port: 7d758c28-5119-4575-8aae-fa9c017e56ad, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '908c9756-53a1-4c99-846c-262c66bbb074', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '50a57de3-5738-4399-9f1b-3d7d294c86dc'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:01:35.040750 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:35.045005 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-b55637c0-25a8-434e-9356-645b77f16278 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3754354 Sep 01 17:01:35.061029 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Request body: {'port': {'device_id': 'f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:35.112727 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-db9955c9-1a9b-48bc-bd9f-e51472495680 None None] Provisioning for port b4fb0a19-69a3-49ac-877e-9d08996f0c77 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:01:35.117342 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-db9955c9-1a9b-48bc-bd9f-e51472495680 None None] Provisioning complete for port b4fb0a19-69a3-49ac-877e-9d08996f0c77 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:01:35.117896 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-db9955c9-1a9b-48bc-bd9f-e51472495680 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:35.152934 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-db9955c9-1a9b-48bc-bd9f-e51472495680 None None] Port b4fb0a19-69a3-49ac-877e-9d08996f0c77 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:01:35.179994 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:35.189785 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] For port 7d758c28-5119-4575-8aae-fa9c017e56ad, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:01:35.227426 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] For port 7d758c28-5119-4575-8aae-fa9c017e56ad, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=7d758c28-5119-4575-8aae-fa9c017e56ad,segment=NetworkSegment(908c9756-53a1-4c99-846c-262c66bbb074),segment_id=908c9756-53a1-4c99-846c-262c66bbb074)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:01:35.234322 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:35.287328 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:35.288036 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:35.289499 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] 10.222.0.69 "PUT /v2.0/ports/7d758c28-5119-4575-8aae-fa9c017e56ad HTTP/1.1" status: 200 len: 1093 time: 1.3532419 Sep 01 17:01:35.290811 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0665ed54-9cf9-4fb0-8ac8-e671808548d1', 'tag': '7d758c28-5119-4575-8aae-fa9c017e56ad'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:35.292222 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f207c0c4-d69b-46cb-bce0-2b1b3368ba79" -d '{"events": [{"name": "network-changed", "server_uuid": "0665ed54-9cf9-4fb0-8ac8-e671808548d1", "tag": "7d758c28-5119-4575-8aae-fa9c017e56ad"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:35.360120 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec21d118-c6a8-4604-aba7-a3766a3ba58e req-d1bf4600-81c0-4a1c-a4b1-9203c46971dd tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:35.368625 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ec21d118-c6a8-4604-aba7-a3766a3ba58e req-d1bf4600-81c0-4a1c-a4b1-9203c46971dd tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 943 time: 0.0928488 Sep 01 17:01:35.392171 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-add373b8-f222-42ee-b539-9b423ff224b7 service neutron] Pushing event updated for resources: {'Port': ['ID=7d758c28-5119-4575-8aae-fa9c017e56ad,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:35.413652 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ec21d118-c6a8-4604-aba7-a3766a3ba58e req-956b8377-d85e-4a06-8be9-db53e57c48f5 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439496 Sep 01 17:01:35.472932 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f53494a3-77b7-4c16-83b8-d1214a2b30fa x-openstack-request-id: req-f53494a3-77b7-4c16-83b8-d1214a2b30fa {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:35.473238 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0665ed54-9cf9-4fb0-8ac8-e671808548d1", "tag": "7d758c28-5119-4575-8aae-fa9c017e56ad", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:35.473515 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-f53494a3-77b7-4c16-83b8-d1214a2b30fa {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:35.473926 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0665ed54-9cf9-4fb0-8ac8-e671808548d1', 'tag': '7d758c28-5119-4575-8aae-fa9c017e56ad', 'status': 'completed', 'code': 200} Sep 01 17:01:35.485996 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-d246b86d-26a7-432c-bb85-09ad1bc30458 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:35.485996 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-d246b86d-26a7-432c-bb85-09ad1bc30458 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7ddcba698dfe424a89ef6b0fa2e10ae6&device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 1096 time: 0.1019731 Sep 01 17:01:35.549794 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-acd654ef-10f5-494f-968a-1203c11d489c service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7d758c28-5119-4575-8aae-fa9c017e56ad HTTP/1.1" status: 200 len: 217 time: 0.0495229 Sep 01 17:01:35.586815 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca350cde-e877-4770-9374-b103901eb343 req-1bd452dd-3475-4b47-a4d8-d483eb21df9a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:35.588430 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ca350cde-e877-4770-9374-b103901eb343 req-1bd452dd-3475-4b47-a4d8-d483eb21df9a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0585246 Sep 01 17:01:35.627376 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ca350cde-e877-4770-9374-b103901eb343 req-921cb816-d6e7-472d-8fd6-d9ecb401d2ad tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328794 Sep 01 17:01:35.646967 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-771e29a3-435f-4d5c-8178-4b86573f97dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:35.646967 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-771e29a3-435f-4d5c-8178-4b86573f97dc service neutron] 10.222.0.69 "GET /v2.0/subnets?id=666c0d30-db52-4561-9b93-97a824a51a0d HTTP/1.1" status: 200 len: 853 time: 0.0850747 Sep 01 17:01:35.668455 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b4fb0a19-69a3-49ac-877e-9d08996f0c77 {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:01:35.691227 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-3171cb5b-b3f5-42d8-b5e3-8054401363af service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=50a57de3-5738-4399-9f1b-3d7d294c86dc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0353842 Sep 01 17:01:35.693201 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:35.706538 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Transition to ACTIVE for port object b4fb0a19-69a3-49ac-877e-9d08996f0c77 will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:01:35.727966 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:35.772276 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5f784e3-8379-443b-9d56-53fa5661eaf0 req-8d98dacc-14bc-4261-be7b-30e1fb5ac5d0 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:35.774127 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b5f784e3-8379-443b-9d56-53fa5661eaf0 req-8d98dacc-14bc-4261-be7b-30e1fb5ac5d0 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0558801 Sep 01 17:01:35.821543 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b5f784e3-8379-443b-9d56-53fa5661eaf0 req-512698c7-beee-4737-bc72-f5545264e886 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405345 Sep 01 17:01:35.838356 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Pushing event updated for resources: {'Port': ['ID=b4fb0a19-69a3-49ac-877e-9d08996f0c77,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:35.895845 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-ba97d817-d8f5-4d4b-a41d-2991535978c6 service neutron] 10.222.0.69 "GET /v2.0/networks/50a57de3-5738-4399-9f1b-3d7d294c86dc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1874442 Sep 01 17:01:35.908345 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea572541-aef8-4acf-9009-bc4249437fb0 req-15f45764-7514-4767-92af-75335a706caa tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:35.909970 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ea572541-aef8-4acf-9009-bc4249437fb0 req-15f45764-7514-4767-92af-75335a706caa tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 943 time: 0.0683904 Sep 01 17:01:35.966029 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ea572541-aef8-4acf-9009-bc4249437fb0 req-53cccfcb-cb8d-4580-a716-ffd093627d4f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478261 Sep 01 17:01:36.006038 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Attempting to bind port b4fb0a19-69a3-49ac-877e-9d08996f0c77 on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:01:36.006650 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Attempting to bind port b4fb0a19-69a3-49ac-877e-9d08996f0c77 by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:01:36.006798 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Attempting to bind port b4fb0a19-69a3-49ac-877e-9d08996f0c77 on network 35c995f2-96ec-4a35-9f59-05221a09df3f {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:01:36.046724 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Port b4fb0a19-69a3-49ac-877e-9d08996f0c77 on network 35c995f2-96ec-4a35-9f59-05221a09df3f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:01:36.047057 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Attempting to bind port b4fb0a19-69a3-49ac-877e-9d08996f0c77 on network 35c995f2-96ec-4a35-9f59-05221a09df3f {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:01:36.072481 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 1, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:01:36.072847 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Checking segment: {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:01:36.073229 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Bound using segment: {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:01:36.073695 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Bound port: b4fb0a19-69a3-49ac-877e-9d08996f0c77, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:01:36.074055 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:36.076744 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1940058-ccb5-4957-9e10-b749e85581e4 req-7e874c95-1ada-4977-9470-777f018e1378 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:36.078795 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a1940058-ccb5-4957-9e10-b749e85581e4 req-7e874c95-1ada-4977-9470-777f018e1378 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0595481 Sep 01 17:01:36.115555 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-751b9b7b-2b81-4521-ab02-383a96aa9cc1 req-4f2c8cb5-a36e-41bd-9437-ddc10d88a53b service neutron] 10.222.0.69 "GET /v2.0/networks/50a57de3-5738-4399-9f1b-3d7d294c86dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2064838 Sep 01 17:01:36.119389 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a1940058-ccb5-4957-9e10-b749e85581e4 req-e3c0324d-eaef-4b30-8ecb-5c8b444c4e5a tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338144 Sep 01 17:01:36.139533 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35ba1ded-4ae2-4d4a-8eb8-8b3512fa8baa req-a3b6c20e-f45a-47d6-90ea-ca3e46816740 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:36.141036 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-35ba1ded-4ae2-4d4a-8eb8-8b3512fa8baa req-a3b6c20e-f45a-47d6-90ea-ca3e46816740 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=4199ca0b18374af7856c19238fc2fea1&device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 1098 time: 0.1301010 Sep 01 17:01:36.229196 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] For port b4fb0a19-69a3-49ac-877e-9d08996f0c77, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:01:36.264470 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] For port b4fb0a19-69a3-49ac-877e-9d08996f0c77, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=b4fb0a19-69a3-49ac-877e-9d08996f0c77,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:01:36.273208 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:36.336576 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:36.337429 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:36.338803 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] 10.222.0.69 "PUT /v2.0/ports/b4fb0a19-69a3-49ac-877e-9d08996f0c77 HTTP/1.1" status: 200 len: 1093 time: 1.2837958 Sep 01 17:01:36.346812 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f207c0c4-d69b-46cb-bce0-2b1b3368ba79 req-f63937ac-51e7-4f1e-9ef6-8f409474b192 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:36.350110 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f207c0c4-d69b-46cb-bce0-2b1b3368ba79 req-f63937ac-51e7-4f1e-9ef6-8f409474b192 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7ddcba698dfe424a89ef6b0fa2e10ae6&device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 1096 time: 0.1608479 Sep 01 17:01:36.353034 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35ba1ded-4ae2-4d4a-8eb8-8b3512fa8baa req-347b743d-44c1-433b-bada-fb2485fbb563 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:36.354513 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-35ba1ded-4ae2-4d4a-8eb8-8b3512fa8baa req-347b743d-44c1-433b-bada-fb2485fbb563 service neutron] 10.222.0.69 "GET /v2.0/networks?id=63606bb0-66bd-46d6-ba6c-55c6da830865 HTTP/1.1" status: 200 len: 920 time: 0.1897480 Sep 01 17:01:36.369785 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39f69660-6a2b-4525-921a-fbe9297c1a7d service neutron] Pushing event updated for resources: {'Port': ['ID=b4fb0a19-69a3-49ac-877e-9d08996f0c77,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:36.469141 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-35ba1ded-4ae2-4d4a-8eb8-8b3512fa8baa req-9e1250aa-7f0d-4924-8d7a-ed249a8abb1c service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e3d13334-c7d0-4f40-a25b-5c27c5f90c65 HTTP/1.1" status: 200 len: 217 time: 0.0735574 Sep 01 17:01:36.548611 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c113bb0-6e86-4c36-8a75-62fe2b1a3f9a req-f02e70d9-39b4-4713-b0a1-9f67d66190d3 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:36.550269 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3c113bb0-6e86-4c36-8a75-62fe2b1a3f9a req-f02e70d9-39b4-4713-b0a1-9f67d66190d3 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 943 time: 0.0619748 Sep 01 17:01:36.560102 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35ba1ded-4ae2-4d4a-8eb8-8b3512fa8baa req-66034c25-34e8-41a3-bc95-359b4d6ffc60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:36.561591 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-35ba1ded-4ae2-4d4a-8eb8-8b3512fa8baa req-66034c25-34e8-41a3-bc95-359b4d6ffc60 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=fd331d5b-40b1-4163-8537-7af4e56f1efd HTTP/1.1" status: 200 len: 859 time: 0.0735772 Sep 01 17:01:36.563215 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-270c4129-4279-4ef8-96bc-c01a47f2228e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:36.564541 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-270c4129-4279-4ef8-96bc-c01a47f2228e service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 1096 time: 0.1372125 Sep 01 17:01:36.574718 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f207c0c4-d69b-46cb-bce0-2b1b3368ba79 req-b2b8a9d0-bf3a-471c-ae83-0dcd204647a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:36.576282 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f207c0c4-d69b-46cb-bce0-2b1b3368ba79 req-b2b8a9d0-bf3a-471c-ae83-0dcd204647a1 service neutron] 10.222.0.69 "GET /v2.0/networks?id=50a57de3-5738-4399-9f1b-3d7d294c86dc HTTP/1.1" status: 200 len: 914 time: 0.2002940 Sep 01 17:01:36.591551 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3c113bb0-6e86-4c36-8a75-62fe2b1a3f9a req-f9b3b2d5-2999-4dfb-91a2-29beb61a0851 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0349178 Sep 01 17:01:36.640957 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-35ba1ded-4ae2-4d4a-8eb8-8b3512fa8baa req-d8aba0ce-b3c4-46ea-96bf-fd82b4294dca service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=63606bb0-66bd-46d6-ba6c-55c6da830865&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0638690 Sep 01 17:01:36.669063 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-d7edba96-99c4-4153-9ede-2cee67380ce9 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b4fb0a19-69a3-49ac-877e-9d08996f0c77 HTTP/1.1" status: 200 len: 217 time: 0.0909824 Sep 01 17:01:36.676145 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f207c0c4-d69b-46cb-bce0-2b1b3368ba79 req-6ec51816-fe9f-4c16-80a7-7634e6198f89 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7d758c28-5119-4575-8aae-fa9c017e56ad HTTP/1.1" status: 200 len: 217 time: 0.0837207 Sep 01 17:01:36.806470 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-5ad06cb1-7c68-4d84-a289-1734a5fe965f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:36.807822 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-5ad06cb1-7c68-4d84-a289-1734a5fe965f service neutron] 10.222.0.69 "GET /v2.0/subnets?id=ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 200 len: 850 time: 0.0938182 Sep 01 17:01:36.814204 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f207c0c4-d69b-46cb-bce0-2b1b3368ba79 req-af9aa753-455b-4aab-9f8f-2024a3a1272d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:36.815520 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f207c0c4-d69b-46cb-bce0-2b1b3368ba79 req-af9aa753-455b-4aab-9f8f-2024a3a1272d service neutron] 10.222.0.69 "GET /v2.0/subnets?id=666c0d30-db52-4561-9b93-97a824a51a0d HTTP/1.1" status: 200 len: 853 time: 0.1003904 Sep 01 17:01:36.828525 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-35ba1ded-4ae2-4d4a-8eb8-8b3512fa8baa req-60f93295-295d-40c6-b826-5adf34495baa service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1613536 Sep 01 17:01:36.919826 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f207c0c4-d69b-46cb-bce0-2b1b3368ba79 req-3788c0b9-4cf8-475d-bfca-207528982ee9 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=50a57de3-5738-4399-9f1b-3d7d294c86dc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0789523 Sep 01 17:01:36.948258 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-545c90f9-dbf4-46ea-8b08-54dd08983ee1 req-84314662-48ac-4f3f-ade2-fcac8e3226fe tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:36.949767 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-545c90f9-dbf4-46ea-8b08-54dd08983ee1 req-84314662-48ac-4f3f-ade2-fcac8e3226fe tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0542102 Sep 01 17:01:36.987124 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-545c90f9-dbf4-46ea-8b08-54dd08983ee1 req-f8f96058-f6cb-4abf-b311-d0206cccb218 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314181 Sep 01 17:01:37.102928 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6938f9a6-2565-4798-8f24-be55d19ee646 req-1cf8f97e-fb93-460f-be41-24dd102159e6 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:37.104489 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6938f9a6-2565-4798-8f24-be55d19ee646 req-1cf8f97e-fb93-460f-be41-24dd102159e6 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 943 time: 0.0549419 Sep 01 17:01:37.145923 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6938f9a6-2565-4798-8f24-be55d19ee646 req-28261c16-d72e-4b27-ac31-f704ed635787 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0350583 Sep 01 17:01:37.194867 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-8998f9a4-2629-4357-8b65-1598b33a1e12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:37.196358 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-8998f9a4-2629-4357-8b65-1598b33a1e12 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=35c995f2-96ec-4a35-9f59-05221a09df3f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.3633568 Sep 01 17:01:37.239589 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a419b29-f925-48d7-afa4-f7b6048d35b4 req-4a94ff19-c0d6-418d-9ab7-796d891f1fcd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:37.242279 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7a419b29-f925-48d7-afa4-f7b6048d35b4 req-4a94ff19-c0d6-418d-9ab7-796d891f1fcd tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0520627 Sep 01 17:01:37.274773 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-35ba1ded-4ae2-4d4a-8eb8-8b3512fa8baa req-928dbf63-806b-4c42-bcbf-5427eeac711c service neutron] 10.222.0.69 "GET /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4329774 Sep 01 17:01:37.282304 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7a419b29-f925-48d7-afa4-f7b6048d35b4 req-e0535271-0943-4b8a-84d3-8270b352c3d3 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0339854 Sep 01 17:01:37.304662 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f207c0c4-d69b-46cb-bce0-2b1b3368ba79 req-d1d4fef0-75de-4a9e-ba6a-28afa1ccca68 service neutron] 10.222.0.69 "GET /v2.0/networks/50a57de3-5738-4399-9f1b-3d7d294c86dc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3673356 Sep 01 17:01:37.377857 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-68382a28-bd4a-435a-8aaa-7ff05b3ffa0c service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1664021 Sep 01 17:01:37.453787 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f207c0c4-d69b-46cb-bce0-2b1b3368ba79 req-512a3562-b65a-4a84-8cb5-3bbc9a0f0467 service neutron] 10.222.0.69 "GET /v2.0/networks/50a57de3-5738-4399-9f1b-3d7d294c86dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1429250 Sep 01 17:01:37.475018 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4', 'tag': 'b4fb0a19-69a3-49ac-877e-9d08996f0c77'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:37.477865 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-24b9d150-1837-4ea6-9ac6-7b6709e96081" -d '{"events": [{"name": "network-changed", "server_uuid": "f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4", "tag": "b4fb0a19-69a3-49ac-877e-9d08996f0c77"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:37.498730 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c6a9a397-c046-4234-b3ea-ff7dcea0f08d req-55744ff2-7c00-4ae7-a885-189f39d74768 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1023276 Sep 01 17:01:37.521838 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-05b4164e-f07d-4120-9018-621849555413 x-openstack-request-id: req-05b4164e-f07d-4120-9018-621849555413 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:37.522114 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4", "tag": "b4fb0a19-69a3-49ac-877e-9d08996f0c77", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:37.522366 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-05b4164e-f07d-4120-9018-621849555413 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:37.522759 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4', 'tag': 'b4fb0a19-69a3-49ac-877e-9d08996f0c77', 'status': 'completed', 'code': 200} Sep 01 17:01:37.611375 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24b9d150-1837-4ea6-9ac6-7b6709e96081 req-a49cc325-d8e3-4307-8cac-a27eb80b68b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:37.612940 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-24b9d150-1837-4ea6-9ac6-7b6709e96081 req-a49cc325-d8e3-4307-8cac-a27eb80b68b1 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 1096 time: 0.0437794 Sep 01 17:01:37.717368 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b310862-7f7c-4487-8619-840667ae5f73 req-b04642d0-d94a-4dc0-a790-611c1a14b969 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:37.718918 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2b310862-7f7c-4487-8619-840667ae5f73 req-b04642d0-d94a-4dc0-a790-611c1a14b969 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 943 time: 0.0569453 Sep 01 17:01:37.725102 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24b9d150-1837-4ea6-9ac6-7b6709e96081 req-c75b5bb5-dc15-4102-a9ea-96de69cbf2c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:37.726626 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-24b9d150-1837-4ea6-9ac6-7b6709e96081 req-c75b5bb5-dc15-4102-a9ea-96de69cbf2c0 service neutron] 10.222.0.69 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 912 time: 0.0922525 Sep 01 17:01:37.756803 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2b310862-7f7c-4487-8619-840667ae5f73 req-b7e82b72-469a-44ed-b6a6-787addebe0e9 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319791 Sep 01 17:01:37.773246 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-24b9d150-1837-4ea6-9ac6-7b6709e96081 req-c4424f6e-ed24-435b-8407-9448c2a1955b service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b4fb0a19-69a3-49ac-877e-9d08996f0c77 HTTP/1.1" status: 200 len: 217 time: 0.0376201 Sep 01 17:01:37.824386 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24b9d150-1837-4ea6-9ac6-7b6709e96081 req-818c2303-9c50-4372-a73a-35b2690cdd9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:37.825833 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-24b9d150-1837-4ea6-9ac6-7b6709e96081 req-818c2303-9c50-4372-a73a-35b2690cdd9e service neutron] 10.222.0.69 "GET /v2.0/subnets?id=ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 200 len: 850 time: 0.0447185 Sep 01 17:01:37.874259 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24b9d150-1837-4ea6-9ac6-7b6709e96081 req-2ee051aa-e31c-464f-b5f1-b7e76e1b5367 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:37.875737 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-24b9d150-1837-4ea6-9ac6-7b6709e96081 req-2ee051aa-e31c-464f-b5f1-b7e76e1b5367 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=35c995f2-96ec-4a35-9f59-05221a09df3f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0398300 Sep 01 17:01:37.971396 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-24b9d150-1837-4ea6-9ac6-7b6709e96081 req-f5e4a229-42c2-4e51-9852-b63370282d96 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856278 Sep 01 17:01:38.076848 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-24b9d150-1837-4ea6-9ac6-7b6709e96081 req-3e5355f0-7e75-4715-bf9b-ab351c726d32 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0971689 Sep 01 17:01:38.112442 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f736e1dc-2441-4102-9f61-6aa2edf46df9 req-34ad66d1-7b8b-43ab-be83-be1499654576 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:38.113949 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f736e1dc-2441-4102-9f61-6aa2edf46df9 req-34ad66d1-7b8b-43ab-be83-be1499654576 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0476842 Sep 01 17:01:38.153959 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f736e1dc-2441-4102-9f61-6aa2edf46df9 req-c6771c58-47ac-40f4-a5a7-8f390fe7be8c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0330932 Sep 01 17:01:38.260055 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d118bd-7746-4170-9d3b-a7785907b3ba req-48ff7146-a429-4fd2-9987-064f75f5b567 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:38.261457 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-09d118bd-7746-4170-9d3b-a7785907b3ba req-48ff7146-a429-4fd2-9987-064f75f5b567 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 943 time: 0.0481329 Sep 01 17:01:38.298327 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-09d118bd-7746-4170-9d3b-a7785907b3ba req-63ce0be4-ce6a-4704-8acb-ff988c1c468a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310581 Sep 01 17:01:38.401855 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aa2040f-1dd6-46de-b484-950d3706a614 req-50539475-8714-4320-900a-c0937d2d465f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:38.403352 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9aa2040f-1dd6-46de-b484-950d3706a614 req-50539475-8714-4320-900a-c0937d2d465f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0516174 Sep 01 17:01:38.440035 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9aa2040f-1dd6-46de-b484-950d3706a614 req-0b9a52f5-67d6-434a-926b-d17720413a6e tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308728 Sep 01 17:01:38.868844 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-466baa45-c00d-4fc7-a88e-41991bd56012 req-2b80c27b-899d-4b0c-b759-2e6d74d19360 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:38.870371 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-466baa45-c00d-4fc7-a88e-41991bd56012 req-2b80c27b-899d-4b0c-b759-2e6d74d19360 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 943 time: 0.0488288 Sep 01 17:01:38.908469 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-466baa45-c00d-4fc7-a88e-41991bd56012 req-fac6a98c-7a83-4ea6-bf42-6d7e0afb8712 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322661 Sep 01 17:01:39.275430 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20dce8e1-7542-43c9-9800-54795b933bd1 req-8247a9af-d723-4c15-98e2-f6c740989818 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:39.277164 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-20dce8e1-7542-43c9-9800-54795b933bd1 req-8247a9af-d723-4c15-98e2-f6c740989818 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0485873 Sep 01 17:01:39.313305 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-20dce8e1-7542-43c9-9800-54795b933bd1 req-3b8d27a6-2a00-4157-bcc1-c8bd67418902 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0302706 Sep 01 17:01:39.420452 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da2f77b-67b4-4168-b507-15a9884e584b req-a5d331ee-a9a5-4014-bdc2-ad6b1f9e1b08 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:39.421944 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4da2f77b-67b4-4168-b507-15a9884e584b req-a5d331ee-a9a5-4014-bdc2-ad6b1f9e1b08 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 943 time: 0.0559089 Sep 01 17:01:39.461166 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4da2f77b-67b4-4168-b507-15a9884e584b req-f4e8c9c8-30c5-4f6d-993a-3d0c6d0fe3fc tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0324235 Sep 01 17:01:39.555032 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef0aa83-a15b-4fde-b1fa-5ed5449efdcd req-8e156850-c42f-453e-bb6a-3e563cf5771f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:39.556587 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6ef0aa83-a15b-4fde-b1fa-5ed5449efdcd req-8e156850-c42f-453e-bb6a-3e563cf5771f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0493753 Sep 01 17:01:39.593668 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6ef0aa83-a15b-4fde-b1fa-5ed5449efdcd req-348fae9d-95d3-49de-8666-faca1e2ad967 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0311029 Sep 01 17:01:40.020463 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0383f03f-9762-4b03-b5bf-86e7ac5ad0bb req-feb7cc52-076f-4dd1-b288-70756fb8f454 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:40.022556 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0383f03f-9762-4b03-b5bf-86e7ac5ad0bb req-feb7cc52-076f-4dd1-b288-70756fb8f454 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 943 time: 0.0496995 Sep 01 17:01:40.059916 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0383f03f-9762-4b03-b5bf-86e7ac5ad0bb req-6fd529b2-fb49-408e-9e8f-d7755d902c25 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312555 Sep 01 17:01:40.434035 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20b9b0e5-7a88-4c58-babc-54996acd73c6 req-97cdd148-f0a9-471d-bd9f-8eda1c4b67ab tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:40.435518 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-20b9b0e5-7a88-4c58-babc-54996acd73c6 req-97cdd148-f0a9-471d-bd9f-8eda1c4b67ab tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 943 time: 0.0525453 Sep 01 17:01:40.469746 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 7d758c28-5119-4575-8aae-fa9c017e56ad details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:01:40.472972 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-20b9b0e5-7a88-4c58-babc-54996acd73c6 req-24e4dabb-6894-4f3c-8f9e-7b6fe9640635 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317280 Sep 01 17:01:40.571171 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 7d758c28-5119-4575-8aae-fa9c017e56ad, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=7d758c28-5119-4575-8aae-fa9c017e56ad,segment=NetworkSegment(908c9756-53a1-4c99-846c-262c66bbb074),segment_id=908c9756-53a1-4c99-846c-262c66bbb074)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:40.575179 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b147653-f22d-40f4-990b-26807ba80358 req-b2225032-0936-40c8-babe-c5d73f23c83a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:40.576688 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6b147653-f22d-40f4-990b-26807ba80358 req-b2225032-0936-40c8-babe-c5d73f23c83a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 943 time: 0.0487821 Sep 01 17:01:40.617103 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6b147653-f22d-40f4-990b-26807ba80358 req-9403ebf9-6e80-4af4-a819-15ce03f46f4d tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0343294 Sep 01 17:01:40.699490 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': '7d758c28-5119-4575-8aae-fa9c017e56ad', 'network_id': '50a57de3-5738-4399-9f1b-3d7d294c86dc', 'port_id': '7d758c28-5119-4575-8aae-fa9c017e56ad', 'mac_address': 'fa:16:3e:f1:0f:6e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 521, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '666c0d30-db52-4561-9b93-97a824a51a0d', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:01:40.719921 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb6471c5-8024-4224-897a-700944860bab req-a4bffb05-ad4d-454b-a2b2-a0baeaae15e1 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:40.721472 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fb6471c5-8024-4224-897a-700944860bab req-a4bffb05-ad4d-454b-a2b2-a0baeaae15e1 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0568163 Sep 01 17:01:40.736802 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:40.750008 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7d758c28-5119-4575-8aae-fa9c017e56ad {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:01:40.759607 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fb6471c5-8024-4224-897a-700944860bab req-618f80c1-a2dc-4d3a-90b5-a9a50519d862 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321758 Sep 01 17:01:40.770114 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 7d758c28-5119-4575-8aae-fa9c017e56ad, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=7d758c28-5119-4575-8aae-fa9c017e56ad,segment=NetworkSegment(908c9756-53a1-4c99-846c-262c66bbb074),segment_id=908c9756-53a1-4c99-846c-262c66bbb074)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:40.774450 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:40.775115 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device f3cd3382-a1bb-4f12-b1b1-64bd000296fb details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:01:40.868204 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=7d758c28-5119-4575-8aae-fa9c017e56ad,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:40.881476 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:40.881838 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:40.882188 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:40.882534 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:40.882876 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:40.883217 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:40.883555 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:40.883886 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:40.884225 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:40.884553 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:40.884883 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:40.885212 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:01:40.931679 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port f3cd3382-a1bb-4f12-b1b1-64bd000296fb, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:40.946063 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'port_id': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'mac_address': 'fa:16:3e:95:9e:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 544, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:01:40.988978 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:41.009665 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f3cd3382-a1bb-4f12-b1b1-64bd000296fb {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:01:41.031873 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port f3cd3382-a1bb-4f12-b1b1-64bd000296fb, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:41.038862 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:41.059527 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b3901cd-b959-4909-8818-0a6897d4b7ad req-50449e33-fd06-425c-a7b3-fe2dbc6ab0ba tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:41.061375 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9b3901cd-b959-4909-8818-0a6897d4b7ad req-50449e33-fd06-425c-a7b3-fe2dbc6ab0ba tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0724144 Sep 01 17:01:41.097025 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-952c1a02-5197-454d-815b-24782e1ce105 req-605f5904-8980-41c7-adab-9e8b7260f9fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:41.098735 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-952c1a02-5197-454d-815b-24782e1ce105 req-605f5904-8980-41c7-adab-9e8b7260f9fb service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=ccf739a17862469f9bbcedc5abe17cd1&device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 1137 time: 0.0762687 Sep 01 17:01:41.111124 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,revision_number=9']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:41.128982 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9b3901cd-b959-4909-8818-0a6897d4b7ad req-47601eae-0f8d-487f-8b77-8bae9f31128e tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0588782 Sep 01 17:01:41.212035 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-952c1a02-5197-454d-815b-24782e1ce105 req-180d5cdf-792c-4ba0-9864-66be6d0fe148 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:41.213551 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-952c1a02-5197-454d-815b-24782e1ce105 req-180d5cdf-792c-4ba0-9864-66be6d0fe148 service neutron] 10.222.0.69 "GET /v2.0/networks?id=ab951243-4254-4532-9d93-c294f4a98543 HTTP/1.1" status: 200 len: 915 time: 0.0956671 Sep 01 17:01:41.221246 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-952e5be4-7f5c-4719-9471-f90749035e36 req-899a734d-68df-4a85-a74b-81ca2aabf5b2 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:41.222763 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-952e5be4-7f5c-4719-9471-f90749035e36 req-899a734d-68df-4a85-a74b-81ca2aabf5b2 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 944 time: 0.0538723 Sep 01 17:01:41.264141 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-952e5be4-7f5c-4719-9471-f90749035e36 req-822bcbc1-70e3-4d2a-b596-f618f43d7c44 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0350342 Sep 01 17:01:41.300696 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-952c1a02-5197-454d-815b-24782e1ce105 req-c68afc1e-1dbf-41bd-9ab1-5d2658c4ef5a service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6f9364de-2626-4bc4-828f-69a19d15adc9 HTTP/1.1" status: 200 len: 1001 time: 0.0687754 Sep 01 17:01:41.355179 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-952c1a02-5197-454d-815b-24782e1ce105 req-34dd2a8e-da23-4123-899f-316484f74f81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:41.356682 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-952c1a02-5197-454d-815b-24782e1ce105 req-34dd2a8e-da23-4123-899f-316484f74f81 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=eda7763d-791a-46fa-8a76-190c2898271d HTTP/1.1" status: 200 len: 853 time: 0.0444920 Sep 01 17:01:41.411192 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-952c1a02-5197-454d-815b-24782e1ce105 req-7c01c6b9-84a1-4d34-a4ad-ee9e78379614 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:41.412932 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-952c1a02-5197-454d-815b-24782e1ce105 req-7c01c6b9-84a1-4d34-a4ad-ee9e78379614 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=ab951243-4254-4532-9d93-c294f4a98543&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0447388 Sep 01 17:01:41.505353 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-952c1a02-5197-454d-815b-24782e1ce105 req-1ae2f126-18d8-490e-8dad-e5a22dedb0c7 service neutron] 10.222.0.69 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836244 Sep 01 17:01:41.543623 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['7d758c28-5119-4575-8aae-fa9c017e56ad'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:01:41.549654 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['f3cd3382-a1bb-4f12-b1b1-64bd000296fb'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:01:41.596345 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ab7ad4-44e8-40d4-8a2c-86639e87bb33 req-c33f168d-9867-4095-ac86-31c2451f6afc tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:41.598189 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-79ab7ad4-44e8-40d4-8a2c-86639e87bb33 req-c33f168d-9867-4095-ac86-31c2451f6afc tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 944 time: 0.0529513 Sep 01 17:01:41.606705 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-952c1a02-5197-454d-815b-24782e1ce105 req-b7ac5204-d864-41ba-9aaf-7e68fa4c466d service neutron] 10.222.0.69 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893943 Sep 01 17:01:41.646515 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-79ab7ad4-44e8-40d4-8a2c-86639e87bb33 req-4d700eac-a88d-4d53-8da2-cc44f8e3683e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406330 Sep 01 17:01:41.750687 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60e7d3fa-3994-45f5-bf00-45297049fcf2 req-921f5055-284c-43a6-b60f-c6a7ed0a6687 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:41.753328 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-60e7d3fa-3994-45f5-bf00-45297049fcf2 req-921f5055-284c-43a6-b60f-c6a7ed0a6687 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 943 time: 0.0607615 Sep 01 17:01:41.795578 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-60e7d3fa-3994-45f5-bf00-45297049fcf2 req-c3254ec4-b1e3-443c-bf6b-a1f7892fb651 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0347602 Sep 01 17:01:42.246125 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5002a5a9-3834-4ab2-bb3f-8cea7c2c9218 req-c863a759-26d5-4901-8109-3eee6b35e537 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:42.247628 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5002a5a9-3834-4ab2-bb3f-8cea7c2c9218 req-c863a759-26d5-4901-8109-3eee6b35e537 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0499468 Sep 01 17:01:42.288173 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5002a5a9-3834-4ab2-bb3f-8cea7c2c9218 req-97cb5828-fd18-42b5-8433-54977ff5fa83 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0345731 Sep 01 17:01:42.380735 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e996ae25-9634-48ad-9f2b-cd414816361e req-68bbfbf7-9ecc-4955-8c0f-3e5be43c6506 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:42.382277 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e996ae25-9634-48ad-9f2b-cd414816361e req-68bbfbf7-9ecc-4955-8c0f-3e5be43c6506 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 944 time: 0.0500569 Sep 01 17:01:42.420269 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e996ae25-9634-48ad-9f2b-cd414816361e req-a0f93484-2aa7-4bbc-a412-1e80797542a7 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320673 Sep 01 17:01:42.772938 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab12568-91db-45ab-9ff9-c732fd3ac643 req-281f63f9-fdb4-4a69-9fed-5adbb84ef523 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:42.774429 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5ab12568-91db-45ab-9ff9-c732fd3ac643 req-281f63f9-fdb4-4a69-9fed-5adbb84ef523 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 944 time: 0.0516868 Sep 01 17:01:42.810411 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5ab12568-91db-45ab-9ff9-c732fd3ac643 req-3834557e-12bd-4c83-bc46-ddd89a90e706 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0298843 Sep 01 17:01:42.915180 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce10387f-4a06-4f50-9587-115c0eaceabb req-2039d0fe-7d22-4858-bddb-34ac137c382a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:42.916699 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ce10387f-4a06-4f50-9587-115c0eaceabb req-2039d0fe-7d22-4858-bddb-34ac137c382a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 943 time: 0.0487933 Sep 01 17:01:42.956144 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ce10387f-4a06-4f50-9587-115c0eaceabb req-d8d02b3c-79ce-492c-840d-3cf1a9dacd94 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0336220 Sep 01 17:01:43.409948 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f9cd2c3-04c1-48cb-a0f0-14c9af616864 req-64fed4f7-7e97-46f6-aa73-2883abb0e6ea tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:43.411501 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8f9cd2c3-04c1-48cb-a0f0-14c9af616864 req-64fed4f7-7e97-46f6-aa73-2883abb0e6ea tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0550723 Sep 01 17:01:43.461368 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8f9cd2c3-04c1-48cb-a0f0-14c9af616864 req-b3da4f67-b5c9-4141-8398-a9a6299b50cc tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0354738 Sep 01 17:01:43.542622 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e514d4-2018-4566-9dae-2dad9bab274d req-eec72067-50b2-4842-be8d-52757d357961 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:43.544166 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-28e514d4-2018-4566-9dae-2dad9bab274d req-eec72067-50b2-4842-be8d-52757d357961 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 944 time: 0.0571694 Sep 01 17:01:43.583016 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-28e514d4-2018-4566-9dae-2dad9bab274d req-e35ad106-f893-4af5-9c26-287b5bde4f62 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328891 Sep 01 17:01:43.933250 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-052e0334-cc70-4af7-b6d5-aa41c3cfee21 req-9c8ca642-9840-4707-8479-f99a178a80e1 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:43.934757 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-052e0334-cc70-4af7-b6d5-aa41c3cfee21 req-9c8ca642-9840-4707-8479-f99a178a80e1 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 944 time: 0.0495567 Sep 01 17:01:43.972445 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-052e0334-cc70-4af7-b6d5-aa41c3cfee21 req-a8d39e81-9362-4df7-9a4c-92add1fe5ddb tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0319653 Sep 01 17:01:44.071351 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07640693-d09b-4890-bbde-065f8fe96e18 req-8e1347db-4640-4574-8053-2ea501691fa0 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:44.072758 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-07640693-d09b-4890-bbde-065f8fe96e18 req-8e1347db-4640-4574-8053-2ea501691fa0 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 943 time: 0.0519245 Sep 01 17:01:44.110331 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-07640693-d09b-4890-bbde-065f8fe96e18 req-5a64a85b-21ba-4d55-a547-72df940723ad tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317256 Sep 01 17:01:44.468787 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 7d758c28-5119-4575-8aae-fa9c017e56ad up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:01:44.539462 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port 7d758c28-5119-4575-8aae-fa9c017e56ad completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:01:44.543736 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port 7d758c28-5119-4575-8aae-fa9c017e56ad triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:01:44.544181 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:44.598375 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51086822-ad45-4802-8145-b155ff025e66 req-2f03b85c-613e-4af4-9459-0a11e268b017 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:44.600605 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-51086822-ad45-4802-8145-b155ff025e66 req-2f03b85c-613e-4af4-9459-0a11e268b017 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0524731 Sep 01 17:01:44.623572 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:44.648387 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-51086822-ad45-4802-8145-b155ff025e66 req-a8cf8a15-23cd-404a-b394-5b76a46e487c tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0409763 Sep 01 17:01:44.649595 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0665ed54-9cf9-4fb0-8ac8-e671808548d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7d758c28-5119-4575-8aae-fa9c017e56ad'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:44.652255 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f32fd849-86c3-46a9-942f-83938339365e" -d '{"events": [{"server_uuid": "0665ed54-9cf9-4fb0-8ac8-e671808548d1", "name": "network-vif-plugged", "status": "completed", "tag": "7d758c28-5119-4575-8aae-fa9c017e56ad"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:44.670399 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 7d758c28-5119-4575-8aae-fa9c017e56ad, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=7d758c28-5119-4575-8aae-fa9c017e56ad,segment=NetworkSegment(908c9756-53a1-4c99-846c-262c66bbb074),segment_id=908c9756-53a1-4c99-846c-262c66bbb074)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:44.674870 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:44.675907 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device f3cd3382-a1bb-4f12-b1b1-64bd000296fb up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:01:44.701243 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6b6ebaba-4a6d-4ffd-a066-a066211c07da x-openstack-request-id: req-6b6ebaba-4a6d-4ffd-a066-a066211c07da {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:44.701615 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0665ed54-9cf9-4fb0-8ac8-e671808548d1", "name": "network-vif-plugged", "status": "completed", "tag": "7d758c28-5119-4575-8aae-fa9c017e56ad", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:44.701875 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-6b6ebaba-4a6d-4ffd-a066-a066211c07da {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:44.702268 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0665ed54-9cf9-4fb0-8ac8-e671808548d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7d758c28-5119-4575-8aae-fa9c017e56ad', 'code': 200} Sep 01 17:01:44.710620 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54d5aa62-921a-4d26-9357-e03a4afa1dc3 req-675cf87e-49ce-47b7-bbd0-0c25d00dcdb4 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:44.712153 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-54d5aa62-921a-4d26-9357-e03a4afa1dc3 req-675cf87e-49ce-47b7-bbd0-0c25d00dcdb4 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 944 time: 0.0565562 Sep 01 17:01:44.758702 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-54d5aa62-921a-4d26-9357-e03a4afa1dc3 req-0e81cd6b-fc04-4e9b-a7f9-65bebcbe111d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389869 Sep 01 17:01:44.780394 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=7d758c28-5119-4575-8aae-fa9c017e56ad,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:44.792343 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port f3cd3382-a1bb-4f12-b1b1-64bd000296fb triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:01:44.792732 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:44.886190 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:44.908968 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba8080b8-708d-48ce-af3f-be938463ef18 req-7c6de0a7-284f-47c6-bff7-925747c208e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:44.910514 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-ba8080b8-708d-48ce-af3f-be938463ef18 req-7c6de0a7-284f-47c6-bff7-925747c208e8 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 1098 time: 0.0428662 Sep 01 17:01:44.918598 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port f3cd3382-a1bb-4f12-b1b1-64bd000296fb, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:44.922899 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:44.948779 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-ba8080b8-708d-48ce-af3f-be938463ef18 req-57a34e52-d5c5-487e-8772-4cc8e5932795 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306675 Sep 01 17:01:44.971334 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,revision_number=10']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:45.090790 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c32ba18-08ee-43e7-a033-82b542c90f2f req-f641b31d-1012-470e-92eb-fe17c118d51d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:45.092230 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1c32ba18-08ee-43e7-a033-82b542c90f2f req-f641b31d-1012-470e-92eb-fe17c118d51d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 946 time: 0.0475833 Sep 01 17:01:45.129155 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1c32ba18-08ee-43e7-a033-82b542c90f2f req-7b5bf3df-ed8c-4c0b-883b-5c80f8483a77 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310314 Sep 01 17:01:45.225631 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88b92bf2-57bd-4de4-9883-74f9d6310c7d req-e374ff4b-0d5f-4a9d-9be8-c1782eceacdd tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:45.227071 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-88b92bf2-57bd-4de4-9883-74f9d6310c7d req-e374ff4b-0d5f-4a9d-9be8-c1782eceacdd tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 943 time: 0.0515001 Sep 01 17:01:45.264706 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-88b92bf2-57bd-4de4-9883-74f9d6310c7d req-3ff60075-3914-47e7-a534-b3bc94cdefcb tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317235 Sep 01 17:01:45.775433 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7a96bd-b909-43f9-9498-b2196db9f296 req-490fd441-ddca-479e-a9a4-24dd38f07012 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:45.777087 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-df7a96bd-b909-43f9-9498-b2196db9f296 req-490fd441-ddca-479e-a9a4-24dd38f07012 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0555196 Sep 01 17:01:45.820281 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-df7a96bd-b909-43f9-9498-b2196db9f296 req-1bb45329-046a-458a-b8c1-04e04a8f8def tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0366039 Sep 01 17:01:45.874941 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9f262b4-aa2f-4462-b69c-cd347cbc2000 req-04a2efb4-3ecd-4653-b867-c9b07b48e70e tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:45.876464 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d9f262b4-aa2f-4462-b69c-cd347cbc2000 req-04a2efb4-3ecd-4653-b867-c9b07b48e70e tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 945 time: 0.0500817 Sep 01 17:01:45.917607 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d9f262b4-aa2f-4462-b69c-cd347cbc2000 req-b266ea21-906d-47e3-9f16-c56cdaba84eb tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0344203 Sep 01 17:01:46.251490 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-245ce7f4-8158-46c5-9c4a-622a1124db41 req-e8a5d794-a808-4a1e-ab0d-0e8cb79365b2 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:46.252964 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-245ce7f4-8158-46c5-9c4a-622a1124db41 req-e8a5d794-a808-4a1e-ab0d-0e8cb79365b2 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 946 time: 0.0506966 Sep 01 17:01:46.291532 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-245ce7f4-8158-46c5-9c4a-622a1124db41 req-443ea88c-89f7-4142-8980-538fd5fd98de tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316520 Sep 01 17:01:46.376767 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64f78d91-9bcd-4378-8129-033076709f08 req-2228db60-0bff-422c-9c02-503a921a7f81 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:46.378294 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-64f78d91-9bcd-4378-8129-033076709f08 req-2228db60-0bff-422c-9c02-503a921a7f81 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 943 time: 0.0499084 Sep 01 17:01:46.417305 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-64f78d91-9bcd-4378-8129-033076709f08 req-908c99c8-77a8-4c11-bf32-86f00f17b24b tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325100 Sep 01 17:01:46.475231 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device b4fb0a19-69a3-49ac-877e-9d08996f0c77 details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:01:46.572101 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port b4fb0a19-69a3-49ac-877e-9d08996f0c77, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=b4fb0a19-69a3-49ac-877e-9d08996f0c77,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:46.583032 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'b4fb0a19-69a3-49ac-877e-9d08996f0c77', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'port_id': 'b4fb0a19-69a3-49ac-877e-9d08996f0c77', 'mac_address': 'fa:16:3e:5c:f5:87', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 511, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:01:46.618535 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:46.630973 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b4fb0a19-69a3-49ac-877e-9d08996f0c77 {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:01:46.648736 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port b4fb0a19-69a3-49ac-877e-9d08996f0c77, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=b4fb0a19-69a3-49ac-877e-9d08996f0c77,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:46.652639 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:46.701290 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=b4fb0a19-69a3-49ac-877e-9d08996f0c77,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:46.704636 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:46.707368 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a3ee6d54-8435-446e-a8cb-1c95bf441544" -d '{"events": [{"server_uuid": "0678fbe1-e92f-49b6-93cd-5babcfc2de18", "name": "network-vif-plugged", "status": "completed", "tag": "f3cd3382-a1bb-4f12-b1b1-64bd000296fb"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:46.743317 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-598bdf39-b562-4869-9420-4fb61a79132c x-openstack-request-id: req-598bdf39-b562-4869-9420-4fb61a79132c {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:46.743610 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0678fbe1-e92f-49b6-93cd-5babcfc2de18", "name": "network-vif-plugged", "status": "completed", "tag": "f3cd3382-a1bb-4f12-b1b1-64bd000296fb", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:46.743859 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-598bdf39-b562-4869-9420-4fb61a79132c {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:46.744255 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'code': 200} Sep 01 17:01:46.921992 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31254b9e-aeff-4548-920b-b4f61b3e03b2 req-bb2c2c01-5e8c-4f1f-bbe4-12a81d708eb6 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:46.923503 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-31254b9e-aeff-4548-920b-b4f61b3e03b2 req-bb2c2c01-5e8c-4f1f-bbe4-12a81d708eb6 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0572569 Sep 01 17:01:46.990612 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-31254b9e-aeff-4548-920b-b4f61b3e03b2 req-7a564925-943a-4460-ab77-e266d507f319 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575554 Sep 01 17:01:46.998705 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca1748c-6618-4c57-841f-e212931a7377 req-f9cf7759-807c-4dae-8ba3-3cd8529137fe tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:47.000126 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-eca1748c-6618-4c57-841f-e212931a7377 req-f9cf7759-807c-4dae-8ba3-3cd8529137fe tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0756125 Sep 01 17:01:47.041576 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-eca1748c-6618-4c57-841f-e212931a7377 req-381a2799-3739-4465-bab7-6794f36cb02e tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0343392 Sep 01 17:01:47.093474 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2484c4d7-cb0c-454a-bdf7-2269cc8cfdcf req-dc1bcf02-c6cb-4a98-89bf-2fa0a3d2ee35 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:47.094911 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2484c4d7-cb0c-454a-bdf7-2269cc8cfdcf req-dc1bcf02-c6cb-4a98-89bf-2fa0a3d2ee35 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0494804 Sep 01 17:01:47.159241 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2484c4d7-cb0c-454a-bdf7-2269cc8cfdcf req-560829c4-3b3a-4d7f-9368-38563d02d6f0 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529130 Sep 01 17:01:47.169988 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df5d58fc-2b25-43e2-ba38-2187a71f09ea req-1eee713f-0871-471f-9ce2-032d2081d63f tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:47.171423 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-df5d58fc-2b25-43e2-ba38-2187a71f09ea req-1eee713f-0871-471f-9ce2-032d2081d63f tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 945 time: 0.0733807 Sep 01 17:01:47.178695 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['b4fb0a19-69a3-49ac-877e-9d08996f0c77'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:01:47.212909 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-df5d58fc-2b25-43e2-ba38-2187a71f09ea req-90848f8d-ecba-4b44-96c0-f0137e60d973 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0351982 Sep 01 17:01:47.439292 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91b5a194-849a-4c0c-9364-2387b79a5ec5 req-c719a5f6-a94d-407e-8235-5c7abb1ec80c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:47.440887 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-91b5a194-849a-4c0c-9364-2387b79a5ec5 req-c719a5f6-a94d-407e-8235-5c7abb1ec80c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 946 time: 0.0619328 Sep 01 17:01:47.484371 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-91b5a194-849a-4c0c-9364-2387b79a5ec5 req-bac39475-0830-4ecd-a2ac-327c006a597a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0364325 Sep 01 17:01:47.526157 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d546d0e-ebbd-4fcd-95c1-85d28b553f8e req-022e8ecc-b992-420f-b120-e6fcd5a57153 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:47.527988 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3d546d0e-ebbd-4fcd-95c1-85d28b553f8e req-022e8ecc-b992-420f-b120-e6fcd5a57153 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 1099 time: 0.0781822 Sep 01 17:01:47.575377 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f45e894-e5ec-4491-8052-ac4ff5967ae7 req-ca09d635-7b69-47fc-b303-372b663926c0 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:47.577328 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7f45e894-e5ec-4491-8052-ac4ff5967ae7 req-ca09d635-7b69-47fc-b303-372b663926c0 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 944 time: 0.0525086 Sep 01 17:01:47.581786 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3d546d0e-ebbd-4fcd-95c1-85d28b553f8e req-eafcbd0f-0505-4f7b-8d29-c2b3a9dc68ad service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0342686 Sep 01 17:01:47.617857 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7f45e894-e5ec-4491-8052-ac4ff5967ae7 req-ee37cf3c-3b06-41e9-a15d-acf095c273c3 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0346444 Sep 01 17:01:48.110935 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ccaa54-3cba-4b49-af0d-8e392cdb276e req-d3944796-a536-40c4-9870-42deb132f540 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:48.112411 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-33ccaa54-3cba-4b49-af0d-8e392cdb276e req-d3944796-a536-40c4-9870-42deb132f540 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0504963 Sep 01 17:01:48.184522 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-33ccaa54-3cba-4b49-af0d-8e392cdb276e req-8b900eb5-567a-46eb-8a50-1fd40601e6c1 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620914 Sep 01 17:01:48.194813 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7031af0b-7c7d-4502-9b55-d131e56b670b req-d6c36fb6-7d0e-4dc4-9d47-59ca385d0fcd tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:48.196284 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7031af0b-7c7d-4502-9b55-d131e56b670b req-d6c36fb6-7d0e-4dc4-9d47-59ca385d0fcd tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0826821 Sep 01 17:01:48.237755 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7031af0b-7c7d-4502-9b55-d131e56b670b req-e9061695-649f-43de-ac0a-7a4db2d46869 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0348494 Sep 01 17:01:48.287482 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bac2dc7-2e00-469c-9307-6a7d204a7bc4 req-7bae32a8-13d6-45bb-a7d0-def59759c5e6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:48.288954 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6bac2dc7-2e00-469c-9307-6a7d204a7bc4 req-7bae32a8-13d6-45bb-a7d0-def59759c5e6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0487700 Sep 01 17:01:48.327349 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6bac2dc7-2e00-469c-9307-6a7d204a7bc4 req-b0f435b9-a24c-47cf-a2fe-27af347f1b51 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324409 Sep 01 17:01:48.611506 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6838f309-9043-4575-aedc-8b1d70856e6b req-b7698bf0-ceb5-4961-bb5a-b2b26fc11ac5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:48.612956 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6838f309-9043-4575-aedc-8b1d70856e6b req-b7698bf0-ceb5-4961-bb5a-b2b26fc11ac5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 946 time: 0.0529785 Sep 01 17:01:48.652101 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6838f309-9043-4575-aedc-8b1d70856e6b req-a216191d-1cec-478a-a084-aeac9cddb58f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325689 Sep 01 17:01:48.736483 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfe33eb8-df03-4613-8c61-12fbd3c5da35 req-0b08b71a-5269-4f3f-82af-60ef5235549a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:48.738013 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-dfe33eb8-df03-4613-8c61-12fbd3c5da35 req-0b08b71a-5269-4f3f-82af-60ef5235549a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 944 time: 0.0515978 Sep 01 17:01:48.780266 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-dfe33eb8-df03-4613-8c61-12fbd3c5da35 req-6fda4834-48be-451a-b72c-fa48815fa284 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0358481 Sep 01 17:01:49.299673 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd582f1-fa5d-4c4f-bfd2-963e6095f271 req-904c4bc8-eb9a-4460-8c42-48c45a9d3d47 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:49.301184 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6cd582f1-fa5d-4c4f-bfd2-963e6095f271 req-904c4bc8-eb9a-4460-8c42-48c45a9d3d47 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0510478 Sep 01 17:01:49.382696 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a235df5-194a-40a4-b510-4d6a32c1f720 req-759bee7b-bfa2-4019-b9aa-277b24fa4ce9 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:49.384187 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3a235df5-194a-40a4-b510-4d6a32c1f720 req-759bee7b-bfa2-4019-b9aa-277b24fa4ce9 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0776610 Sep 01 17:01:49.386868 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6cd582f1-fa5d-4c4f-bfd2-963e6095f271 req-27ad5ae2-0ed0-48a3-aded-8d022ee97a7f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721254 Sep 01 17:01:49.426853 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3a235df5-194a-40a4-b510-4d6a32c1f720 req-2172c59c-8e93-484e-a9ab-b21a7bfa7743 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0363190 Sep 01 17:01:49.494717 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0206fd-f85c-4889-bd22-1ef1428d7bcb req-7f7bdfe2-b2e4-4b75-b369-79db3d905c8f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:49.496230 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0d0206fd-f85c-4889-bd22-1ef1428d7bcb req-7f7bdfe2-b2e4-4b75-b369-79db3d905c8f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0517547 Sep 01 17:01:49.534278 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0d0206fd-f85c-4889-bd22-1ef1428d7bcb req-c66b1bc1-c819-46db-8d7e-86dad967aabc tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322170 Sep 01 17:01:49.770728 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-748418ca-1deb-4907-93de-b1b5c7813493 req-23e027ca-edc7-430c-bbb7-7e64b2e0a53a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:49.772186 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-748418ca-1deb-4907-93de-b1b5c7813493 req-23e027ca-edc7-430c-bbb7-7e64b2e0a53a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 946 time: 0.0485711 Sep 01 17:01:49.812987 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-748418ca-1deb-4907-93de-b1b5c7813493 req-deff8837-761f-437e-b946-7242b583baf5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0342193 Sep 01 17:01:49.898153 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aa7950b-6351-420d-991a-b5ed1db4eec7 req-ed9bb6ca-a76c-4a1c-8591-bbe7957cb870 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:49.899610 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1aa7950b-6351-420d-991a-b5ed1db4eec7 req-ed9bb6ca-a76c-4a1c-8591-bbe7957cb870 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 944 time: 0.0529449 Sep 01 17:01:49.938112 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1aa7950b-6351-420d-991a-b5ed1db4eec7 req-06d5c359-8328-4d19-86b4-6a10eda546cc tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322533 Sep 01 17:01:50.511876 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd2028b-f194-4902-8598-84d5085209b7 req-bc0ee0ae-9707-4765-bfbe-a7d2bb09a35b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:50.513412 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2fd2028b-f194-4902-8598-84d5085209b7 req-bc0ee0ae-9707-4765-bfbe-a7d2bb09a35b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0577276 Sep 01 17:01:50.523540 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device b4fb0a19-69a3-49ac-877e-9d08996f0c77 up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:01:50.571131 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17460061-e6b4-4fba-b474-7a34eddd463a req-a33c999c-56b0-4bb3-b278-9e785774d631 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:50.573101 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-17460061-e6b4-4fba-b474-7a34eddd463a req-a33c999c-56b0-4bb3-b278-9e785774d631 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0778878 Sep 01 17:01:50.576870 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port b4fb0a19-69a3-49ac-877e-9d08996f0c77 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:01:50.587751 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port b4fb0a19-69a3-49ac-877e-9d08996f0c77 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:01:50.588122 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:50.593472 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2fd2028b-f194-4902-8598-84d5085209b7 req-eaae6b74-a1a5-46f0-9f7b-1e87cf8b6b7d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621605 Sep 01 17:01:50.624538 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-17460061-e6b4-4fba-b474-7a34eddd463a req-462c2688-e77b-4790-ab25-c2f9726e329f tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0425925 Sep 01 17:01:50.722395 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8939cdc2-e5ab-4b95-9eb7-6bafe7eebbd6 req-1af400c0-d6dc-44fc-b811-4db218e18714 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:50.725037 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8939cdc2-e5ab-4b95-9eb7-6bafe7eebbd6 req-1af400c0-d6dc-44fc-b811-4db218e18714 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0579803 Sep 01 17:01:50.776878 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8939cdc2-e5ab-4b95-9eb7-6bafe7eebbd6 req-e99618ad-274c-4a58-aef2-4acd4c729c60 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431581 Sep 01 17:01:50.780513 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:50.840001 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4fb0a19-69a3-49ac-877e-9d08996f0c77'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:50.843890 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c6b296a0-ceb4-417a-84b9-5726ea63f16c" -d '{"events": [{"server_uuid": "f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4", "name": "network-vif-plugged", "status": "completed", "tag": "b4fb0a19-69a3-49ac-877e-9d08996f0c77"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:50.863697 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port b4fb0a19-69a3-49ac-877e-9d08996f0c77, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=b4fb0a19-69a3-49ac-877e-9d08996f0c77,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:50.874871 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:50.907392 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1184f589-36e1-463a-9fec-cdd2f7fed6ae x-openstack-request-id: req-1184f589-36e1-463a-9fec-cdd2f7fed6ae {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:50.907682 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4", "name": "network-vif-plugged", "status": "completed", "tag": "b4fb0a19-69a3-49ac-877e-9d08996f0c77", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:50.907936 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-1184f589-36e1-463a-9fec-cdd2f7fed6ae {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:50.908323 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4fb0a19-69a3-49ac-877e-9d08996f0c77', 'code': 200} Sep 01 17:01:50.948387 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=b4fb0a19-69a3-49ac-877e-9d08996f0c77,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:50.956520 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f43fa6-9a9c-4e5b-8986-eca757fefb6c req-69318872-db57-461d-9a2b-1ef55fdb7b0c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:50.958799 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c5f43fa6-9a9c-4e5b-8986-eca757fefb6c req-69318872-db57-461d-9a2b-1ef55fdb7b0c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 946 time: 0.0528786 Sep 01 17:01:50.991560 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-771a5326-7320-4345-ba45-cc75bfeeb867 req-dfa0fd9c-2580-48c2-aef1-e5ff0e5c12c8 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:50.993063 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-771a5326-7320-4345-ba45-cc75bfeeb867 req-dfa0fd9c-2580-48c2-aef1-e5ff0e5c12c8 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 945 time: 0.0559981 Sep 01 17:01:50.999878 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c5f43fa6-9a9c-4e5b-8986-eca757fefb6c req-1af62f41-ee31-40f1-8bac-57057f41be1c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0350382 Sep 01 17:01:51.060741 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b106cf0-67fa-4295-9618-8042f9b16e96 req-3ab258e2-280c-4164-a95b-0237226fb33c tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:51.062302 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5b106cf0-67fa-4295-9618-8042f9b16e96 req-3ab258e2-280c-4164-a95b-0237226fb33c tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 945 time: 0.0533907 Sep 01 17:01:51.094637 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-771a5326-7320-4345-ba45-cc75bfeeb867 req-eed3fa4f-20d2-48aa-81d5-41f8cbc9a545 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Deleting port 45822242-f0ab-4492-b049-73735203e788 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:01:51.094861 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-771a5326-7320-4345-ba45-cc75bfeeb867 req-eed3fa4f-20d2-48aa-81d5-41f8cbc9a545 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:51.103168 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5b106cf0-67fa-4295-9618-8042f9b16e96 req-f33fa24e-99ee-48fe-9af7-509d43dc07e6 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0339763 Sep 01 17:01:51.184841 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-771a5326-7320-4345-ba45-cc75bfeeb867 req-eed3fa4f-20d2-48aa-81d5-41f8cbc9a545 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] For port 45822242-f0ab-4492-b049-73735203e788, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=45822242-f0ab-4492-b049-73735203e788,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:51.185302 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-771a5326-7320-4345-ba45-cc75bfeeb867 req-eed3fa4f-20d2-48aa-81d5-41f8cbc9a545 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:51.200839 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-771a5326-7320-4345-ba45-cc75bfeeb867 req-eed3fa4f-20d2-48aa-81d5-41f8cbc9a545 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Calling delete_port for 45822242-f0ab-4492-b049-73735203e788 owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:01:51.242764 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-0f9557cd-b1fd-4f7b-9e5c-ffdc1673a002 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:51.338207 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950c8102-6685-4f0e-be89-34861f24ddfb req-1e7dc8bf-f0c8-4804-a4c1-af51583a2268 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:51.339729 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-950c8102-6685-4f0e-be89-34861f24ddfb req-1e7dc8bf-f0c8-4804-a4c1-af51583a2268 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 1098 time: 0.0614438 Sep 01 17:01:51.402955 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-771a5326-7320-4345-ba45-cc75bfeeb867 req-eed3fa4f-20d2-48aa-81d5-41f8cbc9a545 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:51.415532 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['3890e11d-5295-488a-9033-9814bb94bf69', '0cf2eaec-e9b1-4ad6-a894-84361c0fe80f', '7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc', '45822242-f0ab-4492-b049-73735203e788'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:01:51.418562 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-950c8102-6685-4f0e-be89-34861f24ddfb req-5a5c7e22-dce2-419c-a0ed-0684fb5fd0dd service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0608196 Sep 01 17:01:51.437725 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eed3fa4f-20d2-48aa-81d5-41f8cbc9a545 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Pushing event deleted for resources: {'Port': ['ID=45822242-f0ab-4492-b049-73735203e788,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:51.491158 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-771a5326-7320-4345-ba45-cc75bfeeb867 req-eed3fa4f-20d2-48aa-81d5-41f8cbc9a545 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] No DVR routers for this DVR port 45822242-f0ab-4492-b049-73735203e788 on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:01:51.494309 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-771a5326-7320-4345-ba45-cc75bfeeb867 req-eed3fa4f-20d2-48aa-81d5-41f8cbc9a545 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:51.496498 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-771a5326-7320-4345-ba45-cc75bfeeb867 req-eed3fa4f-20d2-48aa-81d5-41f8cbc9a545 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "DELETE /v2.0/ports/45822242-f0ab-4492-b049-73735203e788 HTTP/1.1" status: 204 len: 173 time: 0.4956062 Sep 01 17:01:51.496946 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c48c7ff9-8c18-4eae-b554-12334f7fa2e6', 'name': 'network-vif-deleted', 'tag': '45822242-f0ab-4492-b049-73735203e788'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:51.499354 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a938960c-237d-4c4e-a2d5-f036e8420510" -d '{"events": [{"server_uuid": "c48c7ff9-8c18-4eae-b554-12334f7fa2e6", "name": "network-vif-deleted", "tag": "45822242-f0ab-4492-b049-73735203e788"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:51.539606 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-65d7f322-e185-448d-ba1d-1ad57cee8db9 x-openstack-request-id: req-65d7f322-e185-448d-ba1d-1ad57cee8db9 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:51.539904 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c48c7ff9-8c18-4eae-b554-12334f7fa2e6", "name": "network-vif-deleted", "tag": "45822242-f0ab-4492-b049-73735203e788", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:51.540155 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-65d7f322-e185-448d-ba1d-1ad57cee8db9 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:51.540647 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c48c7ff9-8c18-4eae-b554-12334f7fa2e6', 'name': 'network-vif-deleted', 'tag': '45822242-f0ab-4492-b049-73735203e788', 'status': 'completed', 'code': 200} Sep 01 17:01:51.753056 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c18937c-6d24-4038-bb50-77724a7f8cc3 req-16dbc2e7-d81b-47a9-bcdd-8f7928bd160f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:51.762398 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6c18937c-6d24-4038-bb50-77724a7f8cc3 req-16dbc2e7-d81b-47a9-bcdd-8f7928bd160f tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0933793 Sep 01 17:01:51.845579 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6c18937c-6d24-4038-bb50-77724a7f8cc3 req-f4a08ea7-9686-4fff-9a54-da0f754dbaf4 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0820384 Sep 01 17:01:51.855052 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71ace26d-cd6f-4d68-ae3b-043daebdea29 req-30cfa5e2-f743-4c61-83e1-1303311628fe tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:51.856875 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-71ace26d-cd6f-4d68-ae3b-043daebdea29 req-30cfa5e2-f743-4c61-83e1-1303311628fe tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0789115 Sep 01 17:01:51.910016 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-71ace26d-cd6f-4d68-ae3b-043daebdea29 req-eb4bcc17-f824-4c53-bb34-50c77cf1866f tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0367272 Sep 01 17:01:51.949238 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6f37f030-cb96-42bf-bfd6-227e1b6be2e6 req-b943e665-5c05-4b80-91a0-99f689a81a50 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c48c7ff9-8c18-4eae-b554-12334f7fa2e6 HTTP/1.1" status: 200 len: 210 time: 0.0299363 Sep 01 17:01:52.149244 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6cdecb-4e6e-4c47-bf78-5d3842bd5126 req-c5f30324-aafa-453d-80f7-6a7af7f05724 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:52.151093 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-da6cdecb-4e6e-4c47-bf78-5d3842bd5126 req-c5f30324-aafa-453d-80f7-6a7af7f05724 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 946 time: 0.0662394 Sep 01 17:01:52.201706 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-da6cdecb-4e6e-4c47-bf78-5d3842bd5126 req-393b4e4d-5aed-4fb6-a017-a16afc9c5bae tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446680 Sep 01 17:01:52.237861 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-134d86c4-5d67-4158-a1eb-919f5c132c12 req-df1735d5-afc4-48af-aa20-2bfa0e753e7b tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:52.239860 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-134d86c4-5d67-4158-a1eb-919f5c132c12 req-df1735d5-afc4-48af-aa20-2bfa0e753e7b tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 945 time: 0.0643399 Sep 01 17:01:52.280647 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-134d86c4-5d67-4158-a1eb-919f5c132c12 req-560d9492-79b4-4a54-859b-4c831ab0d979 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0350218 Sep 01 17:01:52.966276 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf73a009-dbca-431c-9b9b-a0fd63f3e7df req-bf0cdf54-fc96-416c-a47f-ba5cb8d019bb tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:52.968333 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cf73a009-dbca-431c-9b9b-a0fd63f3e7df req-bf0cdf54-fc96-416c-a47f-ba5cb8d019bb tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0520186 Sep 01 17:01:53.055018 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-204b22ed-9f52-41fc-b387-3e1ce2e3c97f req-e4c00bce-12cf-4717-9068-6cb538b6b61f tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:53.056543 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-204b22ed-9f52-41fc-b387-3e1ce2e3c97f req-e4c00bce-12cf-4717-9068-6cb538b6b61f tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0728164 Sep 01 17:01:53.059225 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cf73a009-dbca-431c-9b9b-a0fd63f3e7df req-e69c7395-e366-4f3a-be7a-1eb4a74b1ff4 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0828249 Sep 01 17:01:53.098078 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-204b22ed-9f52-41fc-b387-3e1ce2e3c97f req-da5f6297-192c-48ff-bc8d-84a4c0558428 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0354204 Sep 01 17:01:53.323755 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb08867a-3fb8-4cbf-95bf-db2619685644 req-ee3bc6b5-aceb-454b-bc2f-dcada267d8df tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:53.325269 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bb08867a-3fb8-4cbf-95bf-db2619685644 req-ee3bc6b5-aceb-454b-bc2f-dcada267d8df tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 946 time: 0.0507977 Sep 01 17:01:53.393893 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bb08867a-3fb8-4cbf-95bf-db2619685644 req-9bd787e1-1ae5-4a9f-9e8d-694bc9d84e28 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0626857 Sep 01 17:01:53.402543 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd46444-9f2a-4121-944e-34b41e4d7e5c req-8a405be1-7578-4bea-9aae-a957941e4434 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:53.404057 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7cd46444-9f2a-4121-944e-34b41e4d7e5c req-8a405be1-7578-4bea-9aae-a957941e4434 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.69 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 945 time: 0.0496602 Sep 01 17:01:53.416392 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ffa470f-ea93-4b8b-939b-792b75e324be req-dc915fa3-6cc8-4bcc-b647-b0f02eb24353 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:53.417893 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6ffa470f-ea93-4b8b-939b-792b75e324be req-dc915fa3-6cc8-4bcc-b647-b0f02eb24353 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 945 time: 0.0710316 Sep 01 17:01:53.455949 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6ffa470f-ea93-4b8b-939b-792b75e324be req-da6c4029-5c12-40ed-9832-b4efbda009ae tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322368 Sep 01 17:01:53.517776 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-7cd46444-9f2a-4121-944e-34b41e4d7e5c req-b013b9da-d233-4597-95c6-95fec3b88f93 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Deleting port 5e47292e-406f-4ed9-9215-3dcfba5fcde4 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:01:53.518114 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-7cd46444-9f2a-4121-944e-34b41e4d7e5c req-b013b9da-d233-4597-95c6-95fec3b88f93 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:53.608311 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-7cd46444-9f2a-4121-944e-34b41e4d7e5c req-b013b9da-d233-4597-95c6-95fec3b88f93 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] For port 5e47292e-406f-4ed9-9215-3dcfba5fcde4, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=5e47292e-406f-4ed9-9215-3dcfba5fcde4,segment=NetworkSegment(9dfcf32c-db95-455a-ac7a-283312e9c7a0),segment_id=9dfcf32c-db95-455a-ac7a-283312e9c7a0)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:53.608590 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-7cd46444-9f2a-4121-944e-34b41e4d7e5c req-b013b9da-d233-4597-95c6-95fec3b88f93 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:53.623475 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-7cd46444-9f2a-4121-944e-34b41e4d7e5c req-b013b9da-d233-4597-95c6-95fec3b88f93 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Calling delete_port for 5e47292e-406f-4ed9-9215-3dcfba5fcde4 owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:01:53.751074 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:53.757550 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-7cd46444-9f2a-4121-944e-34b41e4d7e5c req-b013b9da-d233-4597-95c6-95fec3b88f93 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:53.773757 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-e3ff8a1e-3ac7-4e0f-ab4d-ad231c0a9ad2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:53.794563 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b013b9da-d233-4597-95c6-95fec3b88f93 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Pushing event deleted for resources: {'Port': ['ID=5e47292e-406f-4ed9-9215-3dcfba5fcde4,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:53.838473 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-7cd46444-9f2a-4121-944e-34b41e4d7e5c req-b013b9da-d233-4597-95c6-95fec3b88f93 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] No DVR routers for this DVR port 5e47292e-406f-4ed9-9215-3dcfba5fcde4 on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:01:53.840700 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-7cd46444-9f2a-4121-944e-34b41e4d7e5c req-b013b9da-d233-4597-95c6-95fec3b88f93 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:53.842696 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7cd46444-9f2a-4121-944e-34b41e4d7e5c req-b013b9da-d233-4597-95c6-95fec3b88f93 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.69 "DELETE /v2.0/ports/5e47292e-406f-4ed9-9215-3dcfba5fcde4 HTTP/1.1" status: 204 len: 173 time: 0.4193730 Sep 01 17:01:53.843185 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '891d0bc6-0f97-45d5-a4d2-d329fbe22fd6', 'name': 'network-vif-deleted', 'tag': '5e47292e-406f-4ed9-9215-3dcfba5fcde4'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:53.845361 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d721eb8-b090-4a4f-b13f-642bb028bd72" -d '{"events": [{"server_uuid": "891d0bc6-0f97-45d5-a4d2-d329fbe22fd6", "name": "network-vif-deleted", "tag": "5e47292e-406f-4ed9-9215-3dcfba5fcde4"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:53.886014 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1a747c5c-24bf-4666-9ce9-c82d36f27fda x-openstack-request-id: req-1a747c5c-24bf-4666-9ce9-c82d36f27fda {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:53.886346 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "891d0bc6-0f97-45d5-a4d2-d329fbe22fd6", "name": "network-vif-deleted", "tag": "5e47292e-406f-4ed9-9215-3dcfba5fcde4", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:53.886563 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-1a747c5c-24bf-4666-9ce9-c82d36f27fda {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:53.886964 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '891d0bc6-0f97-45d5-a4d2-d329fbe22fd6', 'name': 'network-vif-deleted', 'tag': '5e47292e-406f-4ed9-9215-3dcfba5fcde4', 'status': 'completed', 'code': 200} Sep 01 17:01:53.932889 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['e3d13334-c7d0-4f40-a25b-5c27c5f90c65', '5e47292e-406f-4ed9-9215-3dcfba5fcde4'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:01:54.170365 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4cbe0704-57d9-41d2-82d0-63701002fee7 req-237cf33d-965b-40b8-a668-d7550834bf92 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=891d0bc6-0f97-45d5-a4d2-d329fbe22fd6 HTTP/1.1" status: 200 len: 210 time: 0.0289264 Sep 01 17:01:54.228832 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae721b8e-b167-40e1-ab13-c00cb2f083b0 req-b27870f8-1d35-4b7a-a9bf-8d19aa37dcb5 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:54.228832 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ae721b8e-b167-40e1-ab13-c00cb2f083b0 req-b27870f8-1d35-4b7a-a9bf-8d19aa37dcb5 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0538163 Sep 01 17:01:54.278412 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ae721b8e-b167-40e1-ab13-c00cb2f083b0 req-cd2ed844-097d-4a6f-867c-cff025d11314 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0425971 Sep 01 17:01:54.437960 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a05136-9e88-4978-9225-2a2180ff0904 req-ede1f464-3f4f-4cbf-90b4-5b13fd2ff68c tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:54.439369 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f5a05136-9e88-4978-9225-2a2180ff0904 req-ede1f464-3f4f-4cbf-90b4-5b13fd2ff68c tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 945 time: 0.0475659 Sep 01 17:01:54.479562 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f5a05136-9e88-4978-9225-2a2180ff0904 req-5d35bc13-f3a6-413e-a354-07dcea5f1eaa tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0333812 Sep 01 17:01:54.526913 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 45822242-f0ab-4492-b049-73735203e788 no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:01:54.548552 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: 45822242-f0ab-4492-b049-73735203e788 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:01:54.548995 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 45822242-f0ab-4492-b049-73735203e788 not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:01:54.549456 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 5e47292e-406f-4ed9-9215-3dcfba5fcde4 no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:01:54.569432 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: 5e47292e-406f-4ed9-9215-3dcfba5fcde4 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:01:54.569791 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 5e47292e-406f-4ed9-9215-3dcfba5fcde4 not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:01:54.586688 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bf9e0fe-3e3a-4ee6-82db-065733a95bde req-301f68e2-b0ff-4fcd-a1c3-0d923b44202a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:54.588150 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9bf9e0fe-3e3a-4ee6-82db-065733a95bde req-301f68e2-b0ff-4fcd-a1c3-0d923b44202a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 945 time: 0.0608060 Sep 01 17:01:54.627278 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9bf9e0fe-3e3a-4ee6-82db-065733a95bde req-5bf75208-dfeb-4b72-98ee-eed47c46cd0b tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0330493 Sep 01 17:01:54.746029 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9610c2ef-c403-4300-b554-e903d0423f64 req-617d6ffb-1700-460d-b6be-fef55e9dec2c tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:54.747399 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9610c2ef-c403-4300-b554-e903d0423f64 req-617d6ffb-1700-460d-b6be-fef55e9dec2c tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 945 time: 0.0498700 Sep 01 17:01:54.786135 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9610c2ef-c403-4300-b554-e903d0423f64 req-d8584274-705a-4acc-befe-c692439cd788 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322325 Sep 01 17:01:54.808221 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 56892) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:54.897812 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:54.950439 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19f28b5e-25ef-408a-bae4-325acea4f597 tempest-TestVolumeBootPattern-345519433 tempest-TestVolumeBootPattern-345519433-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:54.951988 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-19f28b5e-25ef-408a-bae4-325acea4f597 tempest-TestVolumeBootPattern-345519433 tempest-TestVolumeBootPattern-345519433-project-admin] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 1093 time: 0.1426888 Sep 01 17:01:54.954907 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 56896) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:01:54.959932 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Request body: {'floatingip': {'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'port_id': 'b4fb0a19-69a3-49ac-877e-9d08996f0c77', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address': '172.20.0.6'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:01:54.984357 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for floatingip, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:55.081340 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:55.191781 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Allocated IP 172.27.1.70 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/ca6fe9b1-6e45-4190-8340-b26649effa55) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:01:55.297767 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:55.345146 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:55.386308 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:01:55.390859 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:01:55.399066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:01:55.407553 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a554d4a6-2663-4db8-9be6-c7808257c838 req-76541d1d-87f8-4037-a45b-9efe94b22895 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:55.409149 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a554d4a6-2663-4db8-9be6-c7808257c838 req-76541d1d-87f8-4037-a45b-9efe94b22895 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0624883 Sep 01 17:01:55.429417 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'Port': ['ID=ca6fe9b1-6e45-4190-8340-b26649effa55,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:55.482608 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a554d4a6-2663-4db8-9be6-c7808257c838 req-699cd1db-9822-47d0-b0cd-1fdc74e6e165 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0655212 Sep 01 17:01:55.499517 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8148fa75-464c-4868-8ac0-8acf20f97693 req-46e1effc-d443-4e92-8340-2115abf3fa4b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:55.501000 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8148fa75-464c-4868-8ac0-8acf20f97693 req-46e1effc-d443-4e92-8340-2115abf3fa4b tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0671299 Sep 01 17:01:55.541120 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8148fa75-464c-4868-8ac0-8acf20f97693 req-f8fe8d7f-b64f-40f9-85df-bb03c8b8c6ad tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0330787 Sep 01 17:01:55.605712 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c84f5c-475c-476e-b8a4-fd8adf2f3e5b req-abb2b480-bc8b-4a56-a3f8-59cf692cbae9 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:55.607239 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b8c84f5c-475c-476e-b8a4-fd8adf2f3e5b req-abb2b480-bc8b-4a56-a3f8-59cf692cbae9 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 945 time: 0.0527506 Sep 01 17:01:55.645043 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b8c84f5c-475c-476e-b8a4-fd8adf2f3e5b req-03838bca-0adb-4fc1-88d6-c1ed142fe1fd tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318072 Sep 01 17:01:55.919309 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:56.221544 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:56.385104 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:56.389634 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:56.474260 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'Port': ['ID=ca6fe9b1-6e45-4190-8340-b26649effa55,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:56.477555 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:56.480806 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:56.545418 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:56.610533 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.l3_db [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Floating IP b33920bd-7a8f-47e0-98fb-6aec89374880 associated. External IP: 172.27.1.70, port: b4fb0a19-69a3-49ac-877e-9d08996f0c77. Sep 01 17:01:56.642594 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39c05d87-1a9f-4a40-b36f-a7a1a4f0b32e req-f2552d7e-502c-44d1-821b-432982661d48 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:56.644727 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-39c05d87-1a9f-4a40-b36f-a7a1a4f0b32e req-f2552d7e-502c-44d1-821b-432982661d48 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0708199 Sep 01 17:01:56.731061 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-39c05d87-1a9f-4a40-b36f-a7a1a4f0b32e req-29c9ed83-c6eb-4cb7-b484-d7ab125ef026 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0564077 Sep 01 17:01:56.741709 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fba088e9-bcac-4763-acd1-fb442ac65e90 req-408c721f-3247-4143-9591-60eb48a4d372 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:56.743265 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fba088e9-bcac-4763-acd1-fb442ac65e90 req-408c721f-3247-4143-9591-60eb48a4d372 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.1198208 Sep 01 17:01:56.795695 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fba088e9-bcac-4763-acd1-fb442ac65e90 req-f15f2a11-4fe4-4498-a99f-6a7b57e2b165 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427887 Sep 01 17:01:56.844689 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd927494-8de9-408f-88a7-0793b7591402 req-3947fc5a-2530-431d-afac-0a3f2c88094e tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:56.846818 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cd927494-8de9-408f-88a7-0793b7591402 req-3947fc5a-2530-431d-afac-0a3f2c88094e tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 945 time: 0.0543656 Sep 01 17:01:56.864783 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:01:56.892324 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cd927494-8de9-408f-88a7-0793b7591402 req-bc3eef73-83eb-4bfc-9f91-62f39ffc126b tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385296 Sep 01 17:01:56.995184 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:01:57.007308 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7701307-c866-4257-97ac-5953882fe799 None None] Sync routers for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:01:57.013419 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:57.017310 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7701307-c866-4257-97ac-5953882fe799 None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:01:57.017970 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-f7701307-c866-4257-97ac-5953882fe799 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:01:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:01:57.049887 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-c175b095-1ad3-47c2-b805-2eb9a742e118 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.0936866 Sep 01 17:01:57.050524 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4', 'tag': 'b4fb0a19-69a3-49ac-877e-9d08996f0c77'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:57.054004 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9c623867-66ce-4443-b239-93856e4aeeb5" -d '{"events": [{"name": "network-changed", "server_uuid": "f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4", "tag": "b4fb0a19-69a3-49ac-877e-9d08996f0c77"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:57.101607 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3356bcd6-3a24-47a1-b155-2c6f665a1205 x-openstack-request-id: req-3356bcd6-3a24-47a1-b155-2c6f665a1205 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:57.101905 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4", "tag": "b4fb0a19-69a3-49ac-877e-9d08996f0c77", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:57.102164 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-3356bcd6-3a24-47a1-b155-2c6f665a1205 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:57.102570 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4', 'tag': 'b4fb0a19-69a3-49ac-877e-9d08996f0c77', 'status': 'completed', 'code': 200} Sep 01 17:01:57.139515 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-f7701307-c866-4257-97ac-5953882fe799 None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:01:57.196155 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c623867-66ce-4443-b239-93856e4aeeb5 req-9f41aaad-08f9-4293-83b6-f688476c545e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:57.197724 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9c623867-66ce-4443-b239-93856e4aeeb5 req-9f41aaad-08f9-4293-83b6-f688476c545e service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 1098 time: 0.0510790 Sep 01 17:01:57.318131 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c623867-66ce-4443-b239-93856e4aeeb5 req-da6f38b8-c7e0-4b1a-b6ee-ad4605e1ef4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:57.319655 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9c623867-66ce-4443-b239-93856e4aeeb5 req-da6f38b8-c7e0-4b1a-b6ee-ad4605e1ef4f service neutron] 10.222.0.69 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 912 time: 0.1014988 Sep 01 17:01:57.396610 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9c623867-66ce-4443-b239-93856e4aeeb5 req-429bb430-806c-46f3-913a-2a91cfdf37e6 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b4fb0a19-69a3-49ac-877e-9d08996f0c77 HTTP/1.1" status: 200 len: 998 time: 0.0624654 Sep 01 17:01:57.465410 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-f7701307-c866-4257-97ac-5953882fe799 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': 'b33920bd-7a8f-47e0-98fb-6aec89374880', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.70', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': 'b4fb0a19-69a3-49ac-877e-9d08996f0c77', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 478, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:5c:f5:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:01:55Z', 'updated_at': '2021-09-01T17:01:55Z', 'revision_number': 0, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:01:57.492464 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7701307-c866-4257-97ac-5953882fe799 None None] Checking router: 8724afe3-ad3a-4d4f-94c4-4642b6e0afab for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:01:57.500755 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7701307-c866-4257-97ac-5953882fe799 None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:01:57.501369 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-f7701307-c866-4257-97ac-5953882fe799 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:01:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:01:57.523996 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c623867-66ce-4443-b239-93856e4aeeb5 req-6086ae75-5d64-45f9-9a9e-fd1a652cc243 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:57.525775 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9c623867-66ce-4443-b239-93856e4aeeb5 req-6086ae75-5d64-45f9-9a9e-fd1a652cc243 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 200 len: 850 time: 0.0818281 Sep 01 17:01:57.534436 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edfda74f-5905-45a7-8204-a78116ca356f req-2915d159-bd38-4081-8a1c-b277d0d83956 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:57.535927 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-edfda74f-5905-45a7-8204-a78116ca356f req-2915d159-bd38-4081-8a1c-b277d0d83956 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 945 time: 0.0843070 Sep 01 17:01:57.608067 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-f7701307-c866-4257-97ac-5953882fe799 None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:01:57.651942 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c623867-66ce-4443-b239-93856e4aeeb5 req-6f76548a-ee78-4109-ab01-c3ce98229bb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:57.653476 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9c623867-66ce-4443-b239-93856e4aeeb5 req-6f76548a-ee78-4109-ab01-c3ce98229bb4 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=35c995f2-96ec-4a35-9f59-05221a09df3f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1012695 Sep 01 17:01:57.718766 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-edfda74f-5905-45a7-8204-a78116ca356f req-72785829-9173-4452-8312-fbe7a8264a89 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Deleting port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:01:57.719114 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-edfda74f-5905-45a7-8204-a78116ca356f req-72785829-9173-4452-8312-fbe7a8264a89 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:57.823430 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9c623867-66ce-4443-b239-93856e4aeeb5 req-d5a69c05-f780-4245-8541-2db5ab03565d service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1527042 Sep 01 17:01:57.860650 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1642d968-61a3-4ad0-8982-72d250d237d8 req-04888a75-fdb0-44f1-9711-c505789fa959 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:57.867535 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-f7701307-c866-4257-97ac-5953882fe799 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': 'b33920bd-7a8f-47e0-98fb-6aec89374880', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.70', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': 'b4fb0a19-69a3-49ac-877e-9d08996f0c77', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 478, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:5c:f5:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:01:55Z', 'updated_at': '2021-09-01T17:01:55Z', 'revision_number': 0, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:01:57.869465 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1642d968-61a3-4ad0-8982-72d250d237d8 req-04888a75-fdb0-44f1-9711-c505789fa959 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0695348 Sep 01 17:01:57.899022 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7701307-c866-4257-97ac-5953882fe799 None None] The sync data for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi is: [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': 'b33920bd-7a8f-47e0-98fb-6aec89374880', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.70', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': 'b4fb0a19-69a3-49ac-877e-9d08996f0c77', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 478, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:5c:f5:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:01:55Z', 'updated_at': '2021-09-01T17:01:55Z', 'revision_number': 0, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:01:57.901927 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-edfda74f-5905-45a7-8204-a78116ca356f req-72785829-9173-4452-8312-fbe7a8264a89 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] For port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:01:57.902308 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-edfda74f-5905-45a7-8204-a78116ca356f req-72785829-9173-4452-8312-fbe7a8264a89 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:57.922810 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-edfda74f-5905-45a7-8204-a78116ca356f req-72785829-9173-4452-8312-fbe7a8264a89 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Calling delete_port for 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:01:57.942901 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1642d968-61a3-4ad0-8982-72d250d237d8 req-e980b309-3d93-495d-9f7d-1468ec588d57 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0723639 Sep 01 17:01:57.961024 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b4dc1ad-0dc4-4285-b52a-ef92596371bc req-5bf8b54a-d8b9-43c2-a244-45d1b3a5a2e1 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:57.968214 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1b4dc1ad-0dc4-4285-b52a-ef92596371bc req-5bf8b54a-d8b9-43c2-a244-45d1b3a5a2e1 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0946996 Sep 01 17:01:58.004841 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1b4dc1ad-0dc4-4285-b52a-ef92596371bc req-442066d1-44da-4b29-aab7-045e832dd3b3 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0356252 Sep 01 17:01:58.013458 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9c623867-66ce-4443-b239-93856e4aeeb5 req-efc27800-72be-4343-ae44-50201147bcd7 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1777527 Sep 01 17:01:58.084617 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cbb812-0f63-4b5f-91e4-fd384ee46dd3 req-5b1d4109-7841-4381-a7e6-1a8c408ac84f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:58.086418 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-98cbb812-0f63-4b5f-91e4-fd384ee46dd3 req-5b1d4109-7841-4381-a7e6-1a8c408ac84f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=0239f1a0-a747-468c-b1c3-baae21f2e1ae HTTP/1.1" status: 200 len: 945 time: 0.0615773 Sep 01 17:01:58.121896 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-edfda74f-5905-45a7-8204-a78116ca356f req-72785829-9173-4452-8312-fbe7a8264a89 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:58.128991 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-98cbb812-0f63-4b5f-91e4-fd384ee46dd3 req-9a63ad0c-49b4-400f-bdd2-988bba75a515 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0364177 Sep 01 17:01:58.135546 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['3890e11d-5295-488a-9033-9814bb94bf69', '0cf2eaec-e9b1-4ad6-a894-84361c0fe80f', '7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:01:58.158681 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72785829-9173-4452-8312-fbe7a8264a89 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Pushing event deleted for resources: {'Port': ['ID=7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:01:58.184481 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-102292e6-b5e7-4110-b0c0-06fd450d9008 None None] New status for floating IP b33920bd-7a8f-47e0-98fb-6aec89374880: ACTIVE {{(pid=93837) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:01:58.204394 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-edfda74f-5905-45a7-8204-a78116ca356f req-72785829-9173-4452-8312-fbe7a8264a89 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] No DVR routers for this DVR port 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:01:58.206900 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-edfda74f-5905-45a7-8204-a78116ca356f req-72785829-9173-4452-8312-fbe7a8264a89 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:01:58.208880 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-edfda74f-5905-45a7-8204-a78116ca356f req-72785829-9173-4452-8312-fbe7a8264a89 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "DELETE /v2.0/ports/7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc HTTP/1.1" status: 204 len: 173 time: 0.6487577 Sep 01 17:01:59.079706 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81004079-d761-4fc3-8d7d-17e0e33ee8c6 req-7fd553cd-919b-4fb1-a1b4-3bf186c413ea tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:59.081201 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-81004079-d761-4fc3-8d7d-17e0e33ee8c6 req-7fd553cd-919b-4fb1-a1b4-3bf186c413ea tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0664918 Sep 01 17:01:59.103246 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0239f1a0-a747-468c-b1c3-baae21f2e1ae', 'name': 'network-vif-deleted', 'tag': '7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:01:59.105713 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66d70607-cba4-422a-b247-f9bcc0ba5695" -d '{"events": [{"server_uuid": "0239f1a0-a747-468c-b1c3-baae21f2e1ae", "name": "network-vif-deleted", "tag": "7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:01:59.147476 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-81004079-d761-4fc3-8d7d-17e0e33ee8c6 req-135777b6-a9ed-467e-b349-35610ba8bc0b tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0564303 Sep 01 17:01:59.155724 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592c24bc-4b7a-4db4-9108-845542d5de47 req-9a181c1c-b455-4fc1-a47b-16d024ff5569 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:59.157181 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-592c24bc-4b7a-4db4-9108-845542d5de47 req-9a181c1c-b455-4fc1-a47b-16d024ff5569 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0750663 Sep 01 17:01:59.196462 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:01:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c730ff2f-bd07-4e3d-b4da-de6f5bb51e7f x-openstack-request-id: req-c730ff2f-bd07-4e3d-b4da-de6f5bb51e7f {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:01:59.196849 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0239f1a0-a747-468c-b1c3-baae21f2e1ae", "name": "network-vif-deleted", "tag": "7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:01:59.197197 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-c730ff2f-bd07-4e3d-b4da-de6f5bb51e7f {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:01:59.197727 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0239f1a0-a747-468c-b1c3-baae21f2e1ae', 'name': 'network-vif-deleted', 'tag': '7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc', 'status': 'completed', 'code': 200} Sep 01 17:01:59.201191 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-592c24bc-4b7a-4db4-9108-845542d5de47 req-20e7ad79-fbea-4dec-b7e9-cf0dca1ce214 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0368345 Sep 01 17:01:59.438623 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e66ef48-8303-4522-bace-e0ffe1c39163 req-961e5a40-1b68-4e9c-88a2-64c8df83fcce tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:01:59.440009 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8e66ef48-8303-4522-bace-e0ffe1c39163 req-961e5a40-1b68-4e9c-88a2-64c8df83fcce tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 946 time: 0.0492198 Sep 01 17:01:59.476903 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8e66ef48-8303-4522-bace-e0ffe1c39163 req-287b52f3-1476-4f27-a539-30ad4bf88805 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0303056 Sep 01 17:02:00.508176 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd06f139-cfdc-4dca-86cb-68a4d97b475d req-597cc750-9c05-4c79-8358-2b4015d06dd4 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:00.509735 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cd06f139-cfdc-4dca-86cb-68a4d97b475d req-597cc750-9c05-4c79-8358-2b4015d06dd4 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.2936163 Sep 01 17:02:00.522552 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6016325f-ce42-44e6-88b8-2a8503cf44eb req-e461f049-fb98-41fa-b93b-86bc7bddc735 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:00.523983 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6016325f-ce42-44e6-88b8-2a8503cf44eb req-e461f049-fb98-41fa-b93b-86bc7bddc735 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0649724 Sep 01 17:02:00.577720 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:02:00.582362 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cd06f139-cfdc-4dca-86cb-68a4d97b475d req-28368efe-4a58-4d7f-ae14-4d2370aafaaf tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0573535 Sep 01 17:02:00.585624 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6016325f-ce42-44e6-88b8-2a8503cf44eb req-e31a89d6-9df1-4dc4-85f6-8988a2aca801 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547109 Sep 01 17:02:00.601948 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:02:00.602535 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 7b88fa3d-a479-45f1-bd13-91f3f2a1d7dc not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:02:00.689721 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c42fa050-e8a3-4a10-a93a-4ec8d61776dc req-f86b5d05-1cc5-4a93-b7c8-2a0223a71cf6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:00.691219 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c42fa050-e8a3-4a10-a93a-4ec8d61776dc req-f86b5d05-1cc5-4a93-b7c8-2a0223a71cf6 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 946 time: 0.0490596 Sep 01 17:02:00.733495 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c42fa050-e8a3-4a10-a93a-4ec8d61776dc req-d40c7c34-8f36-4121-9a87-48bfbad72f85 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0356543 Sep 01 17:02:01.596329 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-380ac99a-62e7-4676-aad8-efa23e071d87 req-71b32924-3784-46d5-8dce-aa3e7a4fb5bd tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:01.597808 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-380ac99a-62e7-4676-aad8-efa23e071d87 req-71b32924-3784-46d5-8dce-aa3e7a4fb5bd tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 946 time: 0.0515506 Sep 01 17:02:01.710324 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-380ac99a-62e7-4676-aad8-efa23e071d87 req-183f2336-c773-49a0-ae10-8a03e6fd9ac7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Deleting port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:02:01.710673 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-380ac99a-62e7-4676-aad8-efa23e071d87 req-183f2336-c773-49a0-ae10-8a03e6fd9ac7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:01.726345 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8df3ea73-7542-4805-9f45-4771116bcdcf req-f45e094c-be9c-445e-95a2-3880c8c620f8 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:01.727833 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8df3ea73-7542-4805-9f45-4771116bcdcf req-f45e094c-be9c-445e-95a2-3880c8c620f8 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0654387 Sep 01 17:02:01.738050 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a2fa4f-13e5-4ca7-84c2-57f6be38dfe7 req-d10ca429-6386-4336-bd13-493a87f0a749 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:01.739794 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-45a2fa4f-13e5-4ca7-84c2-57f6be38dfe7 req-d10ca429-6386-4336-bd13-493a87f0a749 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0879753 Sep 01 17:02:01.796499 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8df3ea73-7542-4805-9f45-4771116bcdcf req-611543d3-0eae-42e1-92c7-04dc914e94a8 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557580 Sep 01 17:02:01.802248 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-45a2fa4f-13e5-4ca7-84c2-57f6be38dfe7 req-4919cd66-14d1-432c-a9d3-8982ad89a36c tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0540037 Sep 01 17:02:01.802981 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-380ac99a-62e7-4676-aad8-efa23e071d87 req-183f2336-c773-49a0-ae10-8a03e6fd9ac7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] For port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=0cf2eaec-e9b1-4ad6-a894-84361c0fe80f,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:02:01.803363 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-380ac99a-62e7-4676-aad8-efa23e071d87 req-183f2336-c773-49a0-ae10-8a03e6fd9ac7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:01.816883 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-380ac99a-62e7-4676-aad8-efa23e071d87 req-183f2336-c773-49a0-ae10-8a03e6fd9ac7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Calling delete_port for 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:02:01.921259 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3d4477f-c951-44c9-b2d1-87396b8d35d5 req-d458d77f-6571-4db8-b17a-a2a2094bb5c7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:01.922776 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e3d4477f-c951-44c9-b2d1-87396b8d35d5 req-d458d77f-6571-4db8-b17a-a2a2094bb5c7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=c2a87471-715c-4e53-a840-adaa09346bbf HTTP/1.1" status: 200 len: 946 time: 0.0570891 Sep 01 17:02:01.949703 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-380ac99a-62e7-4676-aad8-efa23e071d87 req-183f2336-c773-49a0-ae10-8a03e6fd9ac7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:01.964119 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e3d4477f-c951-44c9-b2d1-87396b8d35d5 req-edfe70fe-fd9a-439c-a6c5-d7226a158730 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0349422 Sep 01 17:02:01.965049 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['3890e11d-5295-488a-9033-9814bb94bf69', '0cf2eaec-e9b1-4ad6-a894-84361c0fe80f'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:02:01.986384 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-183f2336-c773-49a0-ae10-8a03e6fd9ac7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Pushing event deleted for resources: {'Port': ['ID=0cf2eaec-e9b1-4ad6-a894-84361c0fe80f,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:02.024870 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-380ac99a-62e7-4676-aad8-efa23e071d87 req-183f2336-c773-49a0-ae10-8a03e6fd9ac7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] No DVR routers for this DVR port 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:02:02.027618 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-380ac99a-62e7-4676-aad8-efa23e071d87 req-183f2336-c773-49a0-ae10-8a03e6fd9ac7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:02.029848 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-380ac99a-62e7-4676-aad8-efa23e071d87 req-183f2336-c773-49a0-ae10-8a03e6fd9ac7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "DELETE /v2.0/ports/0cf2eaec-e9b1-4ad6-a894-84361c0fe80f HTTP/1.1" status: 204 len: 173 time: 0.4234893 Sep 01 17:02:02.030291 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c2a87471-715c-4e53-a840-adaa09346bbf', 'name': 'network-vif-deleted', 'tag': '0cf2eaec-e9b1-4ad6-a894-84361c0fe80f'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:02:02.033070 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-15ab1741-331f-465d-bc1a-a7b656604816" -d '{"events": [{"server_uuid": "c2a87471-715c-4e53-a840-adaa09346bbf", "name": "network-vif-deleted", "tag": "0cf2eaec-e9b1-4ad6-a894-84361c0fe80f"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:02:02.075688 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:02:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3686ebc-2c49-4f39-bcca-6e3af7670c01 x-openstack-request-id: req-f3686ebc-2c49-4f39-bcca-6e3af7670c01 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:02:02.075688 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c2a87471-715c-4e53-a840-adaa09346bbf", "name": "network-vif-deleted", "tag": "0cf2eaec-e9b1-4ad6-a894-84361c0fe80f", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:02:02.075970 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-f3686ebc-2c49-4f39-bcca-6e3af7670c01 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:02:02.076245 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c2a87471-715c-4e53-a840-adaa09346bbf', 'name': 'network-vif-deleted', 'tag': '0cf2eaec-e9b1-4ad6-a894-84361c0fe80f', 'status': 'completed', 'code': 200} Sep 01 17:02:02.943870 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec5ba37-192d-4294-b30f-d8a54b00a654 req-c7ba6515-de0c-4e57-a2e0-a97e57c8dbc3 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:02.945250 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1ec5ba37-192d-4294-b30f-d8a54b00a654 req-c7ba6515-de0c-4e57-a2e0-a97e57c8dbc3 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0740540 Sep 01 17:02:02.956561 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94999aff-26b6-409d-b4ca-57cead5a322a req-8c71aeda-86f7-4732-a4e8-2e681865aad1 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:02.958881 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-94999aff-26b6-409d-b4ca-57cead5a322a req-8c71aeda-86f7-4732-a4e8-2e681865aad1 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0790930 Sep 01 17:02:03.017836 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1ec5ba37-192d-4294-b30f-d8a54b00a654 req-31982c1c-dbd0-449c-a54e-da3a6d13727b tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0579741 Sep 01 17:02:03.021069 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-94999aff-26b6-409d-b4ca-57cead5a322a req-e46c3015-a31d-4db1-8c2d-213ca003f81d tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557318 Sep 01 17:02:04.164201 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55d65ed6-2a7b-41c9-8675-2ec5b330e030 req-aab3c1db-edc9-4c83-aaa8-72d14cf00690 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:04.165690 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-55d65ed6-2a7b-41c9-8675-2ec5b330e030 req-aab3c1db-edc9-4c83-aaa8-72d14cf00690 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0771344 Sep 01 17:02:04.172815 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0655af8d-93c7-425f-a3fb-6bc5318e7dc2 req-45669bbb-c93d-40cc-abaf-6ccba10a40ca tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:04.174208 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0655af8d-93c7-425f-a3fb-6bc5318e7dc2 req-45669bbb-c93d-40cc-abaf-6ccba10a40ca tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0844445 Sep 01 17:02:04.234700 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-55d65ed6-2a7b-41c9-8675-2ec5b330e030 req-e82278d7-e06a-4d62-a459-f1d90d8980ce tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.67 "GET /v2.0/security-groups?id=46b214ac-e92f-4309-83a4-7ce8205e9d7a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595405 Sep 01 17:02:04.238678 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0655af8d-93c7-425f-a3fb-6bc5318e7dc2 req-180d3e8a-d3a8-4bde-98ff-e358d96237d8 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&id=9dc24496-c4bd-4f26-b512-ce40d586de91&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0566728 Sep 01 17:02:04.252697 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0a8ca57-95a0-4609-b6a3-d5991cb46e83 req-83b76d91-333e-4136-bcda-928e932308ea tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:04.254232 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f0a8ca57-95a0-4609-b6a3-d5991cb46e83 req-83b76d91-333e-4136-bcda-928e932308ea tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.69 "GET /v2.0/ports?device_id=84bd0410-fb41-4744-970f-c2402a7faf77 HTTP/1.1" status: 200 len: 945 time: 0.0491519 Sep 01 17:02:04.356644 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-f0a8ca57-95a0-4609-b6a3-d5991cb46e83 req-50d14abc-7e1d-499f-8e75-d58af6e50008 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Deleting port e3d13334-c7d0-4f40-a25b-5c27c5f90c65 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:02:04.356983 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-f0a8ca57-95a0-4609-b6a3-d5991cb46e83 req-50d14abc-7e1d-499f-8e75-d58af6e50008 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:04.455344 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-f0a8ca57-95a0-4609-b6a3-d5991cb46e83 req-50d14abc-7e1d-499f-8e75-d58af6e50008 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] For port e3d13334-c7d0-4f40-a25b-5c27c5f90c65, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=e3d13334-c7d0-4f40-a25b-5c27c5f90c65,segment=NetworkSegment(9dfcf32c-db95-455a-ac7a-283312e9c7a0),segment_id=9dfcf32c-db95-455a-ac7a-283312e9c7a0)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:02:04.455723 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-f0a8ca57-95a0-4609-b6a3-d5991cb46e83 req-50d14abc-7e1d-499f-8e75-d58af6e50008 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:04.470362 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-f0a8ca57-95a0-4609-b6a3-d5991cb46e83 req-50d14abc-7e1d-499f-8e75-d58af6e50008 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Calling delete_port for e3d13334-c7d0-4f40-a25b-5c27c5f90c65 owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:02:04.472529 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0075a93b-0e23-4cfc-a755-76cd70320eca req-1e590718-8073-4d4c-8d80-7c29a56fb252 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:04.474387 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0075a93b-0e23-4cfc-a755-76cd70320eca req-1e590718-8073-4d4c-8d80-7c29a56fb252 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 945 time: 0.0529354 Sep 01 17:02:04.516167 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0075a93b-0e23-4cfc-a755-76cd70320eca req-86c9b760-1f97-4b66-8c90-10bfcb2c539e tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0354588 Sep 01 17:02:04.606781 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-f0a8ca57-95a0-4609-b6a3-d5991cb46e83 req-50d14abc-7e1d-499f-8e75-d58af6e50008 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:04.627596 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['e3d13334-c7d0-4f40-a25b-5c27c5f90c65'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:02:04.637708 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50d14abc-7e1d-499f-8e75-d58af6e50008 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Pushing event deleted for resources: {'Port': ['ID=e3d13334-c7d0-4f40-a25b-5c27c5f90c65,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:04.683825 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-f0a8ca57-95a0-4609-b6a3-d5991cb46e83 req-50d14abc-7e1d-499f-8e75-d58af6e50008 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] No DVR routers for this DVR port e3d13334-c7d0-4f40-a25b-5c27c5f90c65 on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:02:04.686409 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-f0a8ca57-95a0-4609-b6a3-d5991cb46e83 req-50d14abc-7e1d-499f-8e75-d58af6e50008 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:04.688446 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f0a8ca57-95a0-4609-b6a3-d5991cb46e83 req-50d14abc-7e1d-499f-8e75-d58af6e50008 tempest-ServerRescueNegativeTestJSON-631032510 tempest-ServerRescueNegativeTestJSON-631032510-project] 10.222.0.69 "DELETE /v2.0/ports/e3d13334-c7d0-4f40-a25b-5c27c5f90c65 HTTP/1.1" status: 204 len: 173 time: 0.4268196 Sep 01 17:02:04.688871 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84bd0410-fb41-4744-970f-c2402a7faf77', 'name': 'network-vif-deleted', 'tag': 'e3d13334-c7d0-4f40-a25b-5c27c5f90c65'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:02:04.691148 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7a17db97-a4b4-421b-af2a-1904508f9e86" -d '{"events": [{"server_uuid": "84bd0410-fb41-4744-970f-c2402a7faf77", "name": "network-vif-deleted", "tag": "e3d13334-c7d0-4f40-a25b-5c27c5f90c65"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:02:04.727673 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:02:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5e1482f7-93dd-4825-bfa6-6204da54f9c6 x-openstack-request-id: req-5e1482f7-93dd-4825-bfa6-6204da54f9c6 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:02:04.727968 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "84bd0410-fb41-4744-970f-c2402a7faf77", "name": "network-vif-deleted", "tag": "e3d13334-c7d0-4f40-a25b-5c27c5f90c65", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:02:04.728219 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-5e1482f7-93dd-4825-bfa6-6204da54f9c6 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:02:04.728612 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '84bd0410-fb41-4744-970f-c2402a7faf77', 'name': 'network-vif-deleted', 'tag': 'e3d13334-c7d0-4f40-a25b-5c27c5f90c65', 'status': 'completed', 'code': 200} Sep 01 17:02:05.290737 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 57000) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:05.634430 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c4f21a-b1c3-4d99-81da-b5fe95ba6337 req-8642e002-febd-4e81-9e4d-30c90260c83f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:05.635937 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a7c4f21a-b1c3-4d99-81da-b5fe95ba6337 req-8642e002-febd-4e81-9e4d-30c90260c83f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 945 time: 0.0491951 Sep 01 17:02:05.676766 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a7c4f21a-b1c3-4d99-81da-b5fe95ba6337 req-dfc41463-525d-42b3-96f0-d6afa464a0de tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0341105 Sep 01 17:02:05.721222 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e37f313a-fe02-4cb6-9eb4-53233537e38a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1832465'] for router_interface, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:06.231608 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-e37f313a-fe02-4cb6-9eb4-53233537e38a admin admin] Deleting port c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:02:06.231957 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e37f313a-fe02-4cb6-9eb4-53233537e38a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:06.319039 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [None req-e37f313a-fe02-4cb6-9eb4-53233537e38a admin admin] For port c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5,segment=NetworkSegment(9dfcf32c-db95-455a-ac7a-283312e9c7a0),segment_id=9dfcf32c-db95-455a-ac7a-283312e9c7a0)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:02:06.319709 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e37f313a-fe02-4cb6-9eb4-53233537e38a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:06.333478 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-e37f313a-fe02-4cb6-9eb4-53233537e38a admin admin] Calling delete_port for c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 owned by network:router_interface {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:02:06.438334 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7216b632-f887-4569-acc0-973598b9ed12 req-63ab61c6-a8ad-4863-b381-fbb3683021c7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:06.439799 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7216b632-f887-4569-acc0-973598b9ed12 req-63ab61c6-a8ad-4863-b381-fbb3683021c7 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 945 time: 0.0663664 Sep 01 17:02:06.625930 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-7216b632-f887-4569-acc0-973598b9ed12 req-85ff8ec2-5f7e-473a-a6a4-9fc9ca6e7308 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Deleting port 3890e11d-5295-488a-9033-9814bb94bf69 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:02:06.626273 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-7216b632-f887-4569-acc0-973598b9ed12 req-85ff8ec2-5f7e-473a-a6a4-9fc9ca6e7308 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:06.644166 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:02:06.680837 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e37f313a-fe02-4cb6-9eb4-53233537e38a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:06.714370 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e37f313a-fe02-4cb6-9eb4-53233537e38a admin admin] Pushing event deleted for resources: {'Port': ['ID=c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:06.789884 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:02:06.790975 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 0cf2eaec-e9b1-4ad6-a894-84361c0fe80f not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:02:06.791551 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device e3d13334-c7d0-4f40-a25b-5c27c5f90c65 no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:02:06.813104 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-7216b632-f887-4569-acc0-973598b9ed12 req-85ff8ec2-5f7e-473a-a6a4-9fc9ca6e7308 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] For port 3890e11d-5295-488a-9033-9814bb94bf69, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=3890e11d-5295-488a-9033-9814bb94bf69,segment=NetworkSegment(dc2afa10-206e-4e07-821f-7de675db4aa1),segment_id=dc2afa10-206e-4e07-821f-7de675db4aa1)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:02:06.813104 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-7216b632-f887-4569-acc0-973598b9ed12 req-85ff8ec2-5f7e-473a-a6a4-9fc9ca6e7308 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:06.813328 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: e3d13334-c7d0-4f40-a25b-5c27c5f90c65 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:02:06.813788 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device e3d13334-c7d0-4f40-a25b-5c27c5f90c65 not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:02:06.825331 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-7216b632-f887-4569-acc0-973598b9ed12 req-85ff8ec2-5f7e-473a-a6a4-9fc9ca6e7308 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Calling delete_port for 3890e11d-5295-488a-9033-9814bb94bf69 owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:02:06.834179 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19b19cc7-10dc-443f-969f-5d95d312f57c req-b09ea4af-13de-4769-bec8-f1e23d68497f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:06.835884 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-19b19cc7-10dc-443f-969f-5d95d312f57c req-b09ea4af-13de-4769-bec8-f1e23d68497f tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/ports?device_id=1bb80ba2-8b84-49d5-b868-889e3b7b8630 HTTP/1.1" status: 200 len: 945 time: 0.0639277 Sep 01 17:02:06.872783 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-19b19cc7-10dc-443f-969f-5d95d312f57c req-12c8935a-0ccb-45ae-8c78-0e8f5b78f153 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.67 "GET /v2.0/security-groups?id=38935e02-4c11-46ba-a92f-003a4524abb5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310094 Sep 01 17:02:06.984924 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e37f313a-fe02-4cb6-9eb4-53233537e38a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611377', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1832589'] for router_interface, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:07.118273 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-7216b632-f887-4569-acc0-973598b9ed12 req-85ff8ec2-5f7e-473a-a6a4-9fc9ca6e7308 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:07.130294 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['3890e11d-5295-488a-9033-9814bb94bf69'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:02:07.158290 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85ff8ec2-5f7e-473a-a6a4-9fc9ca6e7308 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Pushing event deleted for resources: {'Port': ['ID=3890e11d-5295-488a-9033-9814bb94bf69,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:07.229834 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-7216b632-f887-4569-acc0-973598b9ed12 req-85ff8ec2-5f7e-473a-a6a4-9fc9ca6e7308 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] No DVR routers for this DVR port 3890e11d-5295-488a-9033-9814bb94bf69 on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:02:07.233209 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-7216b632-f887-4569-acc0-973598b9ed12 req-85ff8ec2-5f7e-473a-a6a4-9fc9ca6e7308 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:07.235176 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7216b632-f887-4569-acc0-973598b9ed12 req-85ff8ec2-5f7e-473a-a6a4-9fc9ca6e7308 tempest-AttachVolumeNegativeTest-1893760502 tempest-AttachVolumeNegativeTest-1893760502-project] 10.222.0.69 "DELETE /v2.0/ports/3890e11d-5295-488a-9033-9814bb94bf69 HTTP/1.1" status: 204 len: 173 time: 0.7541006 Sep 01 17:02:07.235641 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1bb80ba2-8b84-49d5-b868-889e3b7b8630', 'name': 'network-vif-deleted', 'tag': '3890e11d-5295-488a-9033-9814bb94bf69'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:02:07.237949 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0da80d06-35a6-484c-99e1-83e13454cbe8" -d '{"events": [{"server_uuid": "1bb80ba2-8b84-49d5-b868-889e3b7b8630", "name": "network-vif-deleted", "tag": "3890e11d-5295-488a-9033-9814bb94bf69"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:02:07.294756 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:02:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-891e48ae-911c-4c5e-a90c-aba72f4d8813 x-openstack-request-id: req-891e48ae-911c-4c5e-a90c-aba72f4d8813 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:02:07.295049 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1bb80ba2-8b84-49d5-b868-889e3b7b8630", "name": "network-vif-deleted", "tag": "3890e11d-5295-488a-9033-9814bb94bf69", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:02:07.295303 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-891e48ae-911c-4c5e-a90c-aba72f4d8813 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:02:07.295693 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1bb80ba2-8b84-49d5-b868-889e3b7b8630', 'name': 'network-vif-deleted', 'tag': '3890e11d-5295-488a-9033-9814bb94bf69', 'status': 'completed', 'code': 200} Sep 01 17:02:07.325510 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e37f313a-fe02-4cb6-9eb4-53233537e38a admin admin] Router 4cf8f50e-62df-4689-a6af-1d0b8433f43e has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:02:07.437158 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e37f313a-fe02-4cb6-9eb4-53233537e38a admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:02:07.442804 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-e37f313a-fe02-4cb6-9eb4-53233537e38a admin admin] 10.222.0.67 "PUT /v2.0/routers/4cf8f50e-62df-4689-a6af-1d0b8433f43e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1509125 Sep 01 17:02:07.445349 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 57024) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:07.446533 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1abd2706-b464-45c0-b60d-58c21b428581 None None] Sync routers for ids ['4cf8f50e-62df-4689-a6af-1d0b8433f43e'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:02:07.456197 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1abd2706-b464-45c0-b60d-58c21b428581 None None] Routers {'4cf8f50e-62df-4689-a6af-1d0b8433f43e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:02:07.456801 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-1abd2706-b464-45c0-b60d-58c21b428581 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:01:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['4cf8f50e-62df-4689-a6af-1d0b8433f43e'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:02:07.549221 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] Notify callbacks [] for router, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:07.558188 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-1abd2706-b464-45c0-b60d-58c21b428581 None None] Set router 4cf8f50e-62df-4689-a6af-1d0b8433f43e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:02:07.654043 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:07.719125 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] Deleting port f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:02:07.719403 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:07.742637 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-1abd2706-b464-45c0-b60d-58c21b428581 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'name': 'tempest-ServerRescueNegativeTestJSON-2014485163-router', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.181'}], 'enable_snat': True}, 'gw_port_id': 'f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T17:02:06Z', 'revision_number': 5, 'project_id': '4199ca0b18374af7856c19238fc2fea1', 'gw_port': {'id': 'f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6d:5a:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 61, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T16:58:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:02:07.773864 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1abd2706-b464-45c0-b60d-58c21b428581 None None] Checking router: 4cf8f50e-62df-4689-a6af-1d0b8433f43e for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:02:07.782662 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1abd2706-b464-45c0-b60d-58c21b428581 None None] Routers {'4cf8f50e-62df-4689-a6af-1d0b8433f43e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:02:07.783289 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-1abd2706-b464-45c0-b60d-58c21b428581 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:01:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['4cf8f50e-62df-4689-a6af-1d0b8433f43e'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:02:07.808882 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] For port f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:02:07.809253 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:07.824465 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] Calling delete_port for f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 owned by network:router_gateway {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:02:07.873966 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-1abd2706-b464-45c0-b60d-58c21b428581 None None] Set router 4cf8f50e-62df-4689-a6af-1d0b8433f43e gateway port host: None {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:02:07.925592 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-1abd2706-b464-45c0-b60d-58c21b428581 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'name': 'tempest-ServerRescueNegativeTestJSON-2014485163-router', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T17:02:07Z', 'revision_number': 6, 'project_id': '4199ca0b18374af7856c19238fc2fea1', 'gw_port_host': None}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:02:07.929648 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 57030) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:07.955802 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1abd2706-b464-45c0-b60d-58c21b428581 None None] The sync data for ids ['4cf8f50e-62df-4689-a6af-1d0b8433f43e'] in dv-cinder-799668-16-iscsi is: [{'id': '4cf8f50e-62df-4689-a6af-1d0b8433f43e', 'name': 'tempest-ServerRescueNegativeTestJSON-2014485163-router', 'tenant_id': '4199ca0b18374af7856c19238fc2fea1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:17Z', 'updated_at': '2021-09-01T17:02:07Z', 'revision_number': 6, 'project_id': '4199ca0b18374af7856c19238fc2fea1', 'gw_port_host': None}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:02:07.991024 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_v2 [None req-adf6b7a1-57f8-43b1-840d-63d4438ad92f admin admin] Deleting subnet fd025a14-8839-4451-a03e-bc7daeb612d0 {{(pid=93835) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 17:02:08.012720 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-adf6b7a1-57f8-43b1-840d-63d4438ad92f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.059383 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-adf6b7a1-57f8-43b1-840d-63d4438ad92f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8197692'] for subnet, precommit_delete_associations {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.080120 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.115198 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] Pushing event deleted for resources: {'Port': ['ID=f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:08.162478 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-adf6b7a1-57f8-43b1-840d-63d4438ad92f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.208914 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1827887'] for router_gateway, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.316056 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1821713', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4617'] for router, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.319571 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.325930 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-adf6b7a1-57f8-43b1-840d-63d4438ad92f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7342711', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5120114'] for subnet, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.617183 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adf6b7a1-57f8-43b1-840d-63d4438ad92f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fd025a14-8839-4451-a03e-bc7daeb612d0,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:08.621534 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-adf6b7a1-57f8-43b1-840d-63d4438ad92f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.625921 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-adf6b7a1-57f8-43b1-840d-63d4438ad92f admin admin] 10.222.0.67 "DELETE /v2.0/subnets/fd025a14-8839-4451-a03e-bc7daeb612d0 HTTP/1.1" status: 204 len: 168 time: 0.6927991 Sep 01 17:02:08.625921 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1821722'] for router, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.625921 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4cf8f50e-62df-4689-a6af-1d0b8433f43e {{(pid=93835) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 01 17:02:08.626208 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 57032) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:08.631539 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] Notify callbacks [] for router, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.632536 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-7eafa2dc-4443-407b-80fb-6363097eb835 admin admin] 10.222.0.67 "DELETE /v2.0/routers/4cf8f50e-62df-4689-a6af-1d0b8433f43e HTTP/1.1" status: 204 len: 168 time: 1.1862605 Sep 01 17:02:08.634995 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 57034) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:08.677774 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_v2 [None req-9e9135cd-d5b9-4187-ad66-b34f9d594a2e admin admin] Deleting subnet fd331d5b-40b1-4163-8537-7af4e56f1efd {{(pid=93835) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 17:02:08.680723 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9e9135cd-d5b9-4187-ad66-b34f9d594a2e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.699210 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.721738 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9e9135cd-d5b9-4187-ad66-b34f9d594a2e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8197692'] for subnet, precommit_delete_associations {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.772201 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:02:08.779535 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9e9135cd-d5b9-4187-ad66-b34f9d594a2e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.782434 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.793543 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8331b65a-166e-454c-a3c5-ed861dc82dfc']}} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:02:08.793854 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:02:08.794417 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device c2c145d6-fc3c-48e0-a2e0-d7ba4d7b26a5 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:02:08.805335 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dc2afa10-206e-4e07-821f-7de675db4aa1') {'for_net_delete': True} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:02:08.805613 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dc2afa10-206e-4e07-821f-7de675db4aa1') {} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:02:08.814651 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5815145'] for segment, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.833662 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.835778 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9e9135cd-d5b9-4187-ad66-b34f9d594a2e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7342711', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5120114'] for subnet, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.840174 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Releasing vlan 525 on physical network physnet1 to pool {{(pid=93836) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 17:02:08.840592 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6279874'] for segment, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: Traceback (most recent call last): Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: timer() Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: cb(*args, **kw) Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: return func(*args, **kwargs) Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: self._notify() Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: self.callback(batched_events) Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: event.method(event) Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: return f(self, *a, **k) Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: return self._get(url).json() Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: return self.request(url, 'GET', **kwargs) Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 17:02:08.842259 dv-cinder-799668-16-iscsi neutron-server[93836]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 17:02:08.862817 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e9135cd-d5b9-4187-ad66-b34f9d594a2e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fd331d5b-40b1-4163-8537-7af4e56f1efd,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:08.868299 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9e9135cd-d5b9-4187-ad66-b34f9d594a2e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.873371 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-9e9135cd-d5b9-4187-ad66-b34f9d594a2e admin admin] 10.222.0.67 "DELETE /v2.0/subnets/fd331d5b-40b1-4163-8537-7af4e56f1efd HTTP/1.1" status: 204 len: 168 time: 0.2345259 Sep 01 17:02:08.877087 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 57038) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:08.944035 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.953156 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.958336 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] 10.222.0.67 "DELETE /v2.0/networks/8331b65a-166e-454c-a3c5-ed861dc82dfc HTTP/1.1" status: 204 len: 168 time: 0.3279436 Sep 01 17:02:08.978773 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Pushing event deleted for resources: {'Network': ['ID=8331b65a-166e-454c-a3c5-ed861dc82dfc,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:08.982738 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a165cac2-ae83-4043-bddb-2e616ae8e712 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:08.997121 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:08.997500 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:08.997842 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:08.998181 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:08.998508 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:08.998835 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:08.999325 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:08.999832 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:09.000170 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:09.000501 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:09.000827 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:09.001256 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2435403-b83a-4652-967c-02fdf93d0299 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:09.081486 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a165cac2-ae83-4043-bddb-2e616ae8e712 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:09.094114 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 57042) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:09.094261 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-a165cac2-ae83-4043-bddb-2e616ae8e712 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['63606bb0-66bd-46d6-ba6c-55c6da830865']}} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:02:09.106134 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-a165cac2-ae83-4043-bddb-2e616ae8e712 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9dfcf32c-db95-455a-ac7a-283312e9c7a0') {'for_net_delete': True} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:02:09.106134 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-a165cac2-ae83-4043-bddb-2e616ae8e712 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9dfcf32c-db95-455a-ac7a-283312e9c7a0') {} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:02:09.115385 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a165cac2-ae83-4043-bddb-2e616ae8e712 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5815145'] for segment, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:09.132568 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a165cac2-ae83-4043-bddb-2e616ae8e712 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:09.138486 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a165cac2-ae83-4043-bddb-2e616ae8e712 admin admin] Releasing vlan 506 on physical network physnet1 to pool {{(pid=93836) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 17:02:09.138867 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a165cac2-ae83-4043-bddb-2e616ae8e712 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6279874'] for segment, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:09.139738 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-dc2352a3-55af-49ec-b050-0afa8ef7c8b6 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=7032b30e75954f8da9ad2cb64f1f5ad1&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0444627 Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: Traceback (most recent call last): Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: timer() Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: cb(*args, **kw) Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: return func(*args, **kwargs) Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: self._notify() Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: self.callback(batched_events) Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: event.method(event) Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: return f(self, *a, **k) Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: return self._get(url).json() Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: return self.request(url, 'GET', **kwargs) Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 17:02:09.140585 dv-cinder-799668-16-iscsi neutron-server[93836]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 17:02:09.143254 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 57044) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:09.222890 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a165cac2-ae83-4043-bddb-2e616ae8e712 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:09.227634 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a165cac2-ae83-4043-bddb-2e616ae8e712 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:09.229502 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-a165cac2-ae83-4043-bddb-2e616ae8e712 admin admin] 10.222.0.67 "DELETE /v2.0/networks/63606bb0-66bd-46d6-ba6c-55c6da830865 HTTP/1.1" status: 204 len: 168 time: 0.3513436 Sep 01 17:02:09.243903 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a165cac2-ae83-4043-bddb-2e616ae8e712 admin admin] Pushing event deleted for resources: {'Network': ['ID=63606bb0-66bd-46d6-ba6c-55c6da830865,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:09.260418 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-897a4158-27b2-4294-9d96-0e8ead8eea14 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:09.281588 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-897a4158-27b2-4294-9d96-0e8ead8eea14 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:09.327962 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-897a4158-27b2-4294-9d96-0e8ead8eea14 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:09.330663 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-897a4158-27b2-4294-9d96-0e8ead8eea14 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:09.331809 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-897a4158-27b2-4294-9d96-0e8ead8eea14 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/38935e02-4c11-46ba-a92f-003a4524abb5 HTTP/1.1" status: 204 len: 168 time: 0.1883571 Sep 01 17:02:09.339658 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-897a4158-27b2-4294-9d96-0e8ead8eea14 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38935e02-4c11-46ba-a92f-003a4524abb5,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:09.419789 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 57050) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:09.465424 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-e54e66ef-6909-4486-a6e9-bd92e8e79dfb admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=4199ca0b18374af7856c19238fc2fea1&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0436931 Sep 01 17:02:09.467230 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 57054) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:09.517933 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e9521b50-70a1-4506-8e56-0f5ade5ebb16 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:09.539698 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e9521b50-70a1-4506-8e56-0f5ade5ebb16 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:09.586767 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e9521b50-70a1-4506-8e56-0f5ade5ebb16 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:09.589577 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e9521b50-70a1-4506-8e56-0f5ade5ebb16 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:09.590740 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-e9521b50-70a1-4506-8e56-0f5ade5ebb16 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/46b214ac-e92f-4309-83a4-7ce8205e9d7a HTTP/1.1" status: 204 len: 168 time: 0.1226203 Sep 01 17:02:09.599833 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9521b50-70a1-4506-8e56-0f5ade5ebb16 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=46b214ac-e92f-4309-83a4-7ce8205e9d7a,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:10.358966 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:02:10.379704 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:02:10.380064 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device f7ce9ef8-b8fb-464e-9ebc-98d58b2fab55 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:02:10.593319 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:02:10.646771 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 3890e11d-5295-488a-9033-9814bb94bf69 no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:02:10.667432 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: 3890e11d-5295-488a-9033-9814bb94bf69 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:02:10.667806 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 3890e11d-5295-488a-9033-9814bb94bf69 not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:02:16.554883 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 57228) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:16.656494 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0f625130-de3c-4dc9-ae51-0e54ddf755fe admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:16.745683 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0f625130-de3c-4dc9-ae51-0e54ddf755fe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:16.749265 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0f625130-de3c-4dc9-ae51-0e54ddf755fe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:16.786831 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-0f625130-de3c-4dc9-ae51-0e54ddf755fe admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=1cc8c2707ff74a1193a7a57eb6f94a75&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2308426 Sep 01 17:02:16.787646 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f625130-de3c-4dc9-ae51-0e54ddf755fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7e34d05-fd71-4db8-9a8e-b0cd1ea903ec,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:16.789606 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 57232) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:16.837146 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ecbc00d0-20db-4bab-8d1a-75c143596d22 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:16.857760 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ecbc00d0-20db-4bab-8d1a-75c143596d22 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:16.908723 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ecbc00d0-20db-4bab-8d1a-75c143596d22 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:16.912130 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ecbc00d0-20db-4bab-8d1a-75c143596d22 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:16.913268 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-ecbc00d0-20db-4bab-8d1a-75c143596d22 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/f7e34d05-fd71-4db8-9a8e-b0cd1ea903ec HTTP/1.1" status: 204 len: 168 time: 0.1226134 Sep 01 17:02:16.921128 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecbc00d0-20db-4bab-8d1a-75c143596d22 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7e34d05-fd71-4db8-9a8e-b0cd1ea903ec,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:18.834580 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 57296) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:18.937457 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5448e46a-eb19-4dfc-8b99-f1447f9c6b4e admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:19.030309 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5448e46a-eb19-4dfc-8b99-f1447f9c6b4e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:19.034474 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5448e46a-eb19-4dfc-8b99-f1447f9c6b4e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:19.078002 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-5448e46a-eb19-4dfc-8b99-f1447f9c6b4e admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=ee35deadf3d7430c9bb1786457f218d5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2422502 Sep 01 17:02:19.078450 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 57308) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:19.078931 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5448e46a-eb19-4dfc-8b99-f1447f9c6b4e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4c2ab6a-d2d1-4ce9-81cc-aaea704b9362,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:19.128143 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f4843337-f8b2-4569-ab94-ec8f175c3225 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:19.150142 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f4843337-f8b2-4569-ab94-ec8f175c3225 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:19.199141 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f4843337-f8b2-4569-ab94-ec8f175c3225 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:19.202117 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f4843337-f8b2-4569-ab94-ec8f175c3225 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:19.203630 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-f4843337-f8b2-4569-ab94-ec8f175c3225 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/d4c2ab6a-d2d1-4ce9-81cc-aaea704b9362 HTTP/1.1" status: 204 len: 168 time: 0.1240263 Sep 01 17:02:19.212645 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4843337-f8b2-4569-ab94-ec8f175c3225 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4c2ab6a-d2d1-4ce9-81cc-aaea704b9362,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:20.370717 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 57366) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:20.475704 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a26bb563-04b7-4280-a1b1-7770fc719a55 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:20.564221 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a26bb563-04b7-4280-a1b1-7770fc719a55 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:20.568945 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a26bb563-04b7-4280-a1b1-7770fc719a55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:20.607856 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-a26bb563-04b7-4280-a1b1-7770fc719a55 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=353821f668cf495199b01f13b5f22406&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2360559 Sep 01 17:02:20.608692 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a26bb563-04b7-4280-a1b1-7770fc719a55 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ab658d30-4030-4ff7-b630-5e8f3c77fba8,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:20.610607 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 57376) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:20.664896 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-93f3c3e7-a59a-4f48-b8ae-a32df9110f45 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:20.699595 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-93f3c3e7-a59a-4f48-b8ae-a32df9110f45 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:20.769633 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-93f3c3e7-a59a-4f48-b8ae-a32df9110f45 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:20.772403 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-93f3c3e7-a59a-4f48-b8ae-a32df9110f45 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:20.773606 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-93f3c3e7-a59a-4f48-b8ae-a32df9110f45 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/ab658d30-4030-4ff7-b630-5e8f3c77fba8 HTTP/1.1" status: 204 len: 168 time: 0.1618378 Sep 01 17:02:20.782059 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93f3c3e7-a59a-4f48-b8ae-a32df9110f45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ab658d30-4030-4ff7-b630-5e8f3c77fba8,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:21.233579 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-297d9db8-1120-4e16-ab47-bb9db9de3c41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:23.754539 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:23.773604 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-34d63134-36f3-4a81-88c7-9531d47ae48b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:24.901736 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:26.470796 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:26.538107 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:33.706947 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 57602) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:33.814202 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:33.901577 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:33.905959 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:33.944768 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=83f6eebdfc814ad096047cdceee59e76&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2367375 Sep 01 17:02:33.946726 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2ca34374-e630-44db-bf4d-dcb5762a8ca4,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:33.947612 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 57610) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:33.953806 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:33.954166 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:33.954514 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:33.954853 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:33.955178 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:33.955521 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:33.955854 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:33.956187 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:33.956602 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:33.957133 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:33.957569 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:33.957816 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e64e2a-3107-4f0a-94ef-d2d1e23b38cc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:02:33.999781 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-65eff01d-0af4-412a-83ab-46874e89624b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:34.023488 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-65eff01d-0af4-412a-83ab-46874e89624b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:34.077294 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-65eff01d-0af4-412a-83ab-46874e89624b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:34.079872 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-65eff01d-0af4-412a-83ab-46874e89624b admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:34.083721 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-65eff01d-0af4-412a-83ab-46874e89624b admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/2ca34374-e630-44db-bf4d-dcb5762a8ca4 HTTP/1.1" status: 204 len: 168 time: 0.1326160 Sep 01 17:02:34.091144 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65eff01d-0af4-412a-83ab-46874e89624b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2ca34374-e630-44db-bf4d-dcb5762a8ca4,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:35.673162 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 57684) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:35.779957 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3bcc3269-8251-43b7-b669-2ab0d0b04d99 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:35.869454 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3bcc3269-8251-43b7-b669-2ab0d0b04d99 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:35.873735 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3bcc3269-8251-43b7-b669-2ab0d0b04d99 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:35.911725 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-3bcc3269-8251-43b7-b669-2ab0d0b04d99 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=bd9ae725911941c28b87d20bccf82a31&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2374747 Sep 01 17:02:35.912672 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bcc3269-8251-43b7-b669-2ab0d0b04d99 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c68311f8-84e2-4e1e-9a15-0a67f06cb6fb,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:35.914368 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 57688) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:35.966338 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2aaf82d1-f6a3-4fef-a55b-b4c2d7e42bbf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:35.986277 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2aaf82d1-f6a3-4fef-a55b-b4c2d7e42bbf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:36.032852 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2aaf82d1-f6a3-4fef-a55b-b4c2d7e42bbf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:36.036061 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2aaf82d1-f6a3-4fef-a55b-b4c2d7e42bbf admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:36.037234 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-2aaf82d1-f6a3-4fef-a55b-b4c2d7e42bbf admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/c68311f8-84e2-4e1e-9a15-0a67f06cb6fb HTTP/1.1" status: 204 len: 168 time: 0.1218126 Sep 01 17:02:36.045746 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aaf82d1-f6a3-4fef-a55b-b4c2d7e42bbf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c68311f8-84e2-4e1e-9a15-0a67f06cb6fb,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:36.295113 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 57696) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:36.308488 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fdba1315-1f93-4298-8e94-b11f513d1d71 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:36.394298 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fdba1315-1f93-4298-8e94-b11f513d1d71 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:36.398487 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fdba1315-1f93-4298-8e94-b11f513d1d71 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:36.436003 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-fdba1315-1f93-4298-8e94-b11f513d1d71 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=d8c07efec6f74278ad7dfd0c54cd5b2b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1398294 Sep 01 17:02:36.437914 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdba1315-1f93-4298-8e94-b11f513d1d71 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d500cea8-0102-40d7-8737-c0e8e7c4ea52,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:36.438664 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 57702) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:36.491033 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-757e9e0f-346b-490e-a26b-f60154b98299 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:36.514846 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-757e9e0f-346b-490e-a26b-f60154b98299 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:36.564352 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-757e9e0f-346b-490e-a26b-f60154b98299 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:36.567104 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-757e9e0f-346b-490e-a26b-f60154b98299 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:36.568271 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-757e9e0f-346b-490e-a26b-f60154b98299 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/d500cea8-0102-40d7-8737-c0e8e7c4ea52 HTTP/1.1" status: 204 len: 168 time: 0.1283391 Sep 01 17:02:36.577542 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-757e9e0f-346b-490e-a26b-f60154b98299 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d500cea8-0102-40d7-8737-c0e8e7c4ea52,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:36.835448 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-953713b1-5dbe-4d90-8373-f2907e152c8f req-ab357c3f-a051-434f-8bc4-d37945b2e17f service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0411994 Sep 01 17:02:36.910553 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-953713b1-5dbe-4d90-8373-f2907e152c8f req-b405e051-ac10-4703-94d6-39eddc6c962b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:36.912072 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-953713b1-5dbe-4d90-8373-f2907e152c8f req-b405e051-ac10-4703-94d6-39eddc6c962b service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 1099 time: 0.0419581 Sep 01 17:02:37.024977 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-953713b1-5dbe-4d90-8373-f2907e152c8f req-1f8e9dc3-8e97-4106-866c-0d1bc06537b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:37.026969 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-953713b1-5dbe-4d90-8373-f2907e152c8f req-1f8e9dc3-8e97-4106-866c-0d1bc06537b5 service neutron] 10.222.0.69 "GET /v2.0/networks?id=2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 200 len: 917 time: 0.0917542 Sep 01 17:02:37.108874 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-953713b1-5dbe-4d90-8373-f2907e152c8f req-ee2899c1-caa9-4864-880d-9ef5ced63693 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb HTTP/1.1" status: 200 len: 1000 time: 0.0695875 Sep 01 17:02:37.166995 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-953713b1-5dbe-4d90-8373-f2907e152c8f req-18cbcde4-de5b-466a-addb-b370985b3b32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:37.168605 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-953713b1-5dbe-4d90-8373-f2907e152c8f req-18cbcde4-de5b-466a-addb-b370985b3b32 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=58fe425a-6b3e-47bd-b5c0-e68ea7782780 HTTP/1.1" status: 200 len: 855 time: 0.0500989 Sep 01 17:02:37.228586 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-953713b1-5dbe-4d90-8373-f2907e152c8f req-ed25aa00-4804-462a-8314-396ce1420c26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:37.230146 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-953713b1-5dbe-4d90-8373-f2907e152c8f req-ed25aa00-4804-462a-8314-396ce1420c26 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2f7bfe5e-0012-467f-ad7f-aea2467233ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0466762 Sep 01 17:02:37.329186 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-953713b1-5dbe-4d90-8373-f2907e152c8f req-984ba69a-dfa8-426f-8ad7-371789e4e6b7 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0890892 Sep 01 17:02:37.437019 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-953713b1-5dbe-4d90-8373-f2907e152c8f req-43a6e1c6-9fb9-40f5-a3bd-322e74c07791 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0988576 Sep 01 17:02:40.983088 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 57852) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:41.094364 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-78b3bfed-9f7b-4bc7-b123-eb3a07d9bc6d admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:41.199910 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-78b3bfed-9f7b-4bc7-b123-eb3a07d9bc6d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:41.203813 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-78b3bfed-9f7b-4bc7-b123-eb3a07d9bc6d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:41.246298 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-78b3bfed-9f7b-4bc7-b123-eb3a07d9bc6d admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=2595c8ba1eb3418c977b3987f2e33736&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2620745 Sep 01 17:02:41.248298 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78b3bfed-9f7b-4bc7-b123-eb3a07d9bc6d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=776d26b1-af23-4c34-a6cb-d27ad41db1d8,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:41.249013 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 57864) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:41.300991 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b8b0b598-2d99-47b6-a2d6-53173fe3b36a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:41.324722 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b8b0b598-2d99-47b6-a2d6-53173fe3b36a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:41.373229 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b8b0b598-2d99-47b6-a2d6-53173fe3b36a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:41.375767 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b8b0b598-2d99-47b6-a2d6-53173fe3b36a admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:41.376912 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-b8b0b598-2d99-47b6-a2d6-53173fe3b36a admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/776d26b1-af23-4c34-a6cb-d27ad41db1d8 HTTP/1.1" status: 204 len: 168 time: 0.1268907 Sep 01 17:02:41.385494 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8b0b598-2d99-47b6-a2d6-53173fe3b36a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=776d26b1-af23-4c34-a6cb-d27ad41db1d8,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:41.670754 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 57882) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:41.684267 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-353ea463-476b-4ec2-9b91-572d3a6947a2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:41.771534 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-353ea463-476b-4ec2-9b91-572d3a6947a2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:41.775537 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-353ea463-476b-4ec2-9b91-572d3a6947a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:41.811874 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-353ea463-476b-4ec2-9b91-572d3a6947a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60544374-5c3b-436d-b94f-53231e097225,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:41.817161 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-353ea463-476b-4ec2-9b91-572d3a6947a2 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=8d3c332b2d0b44c187246f25039c8b1f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1443546 Sep 01 17:02:41.818709 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 57884) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:41.868063 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3120d8f7-bba5-4595-adf4-b1f7469bc860 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:41.890943 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3120d8f7-bba5-4595-adf4-b1f7469bc860 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:41.944025 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3120d8f7-bba5-4595-adf4-b1f7469bc860 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:41.948501 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3120d8f7-bba5-4595-adf4-b1f7469bc860 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:41.950414 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-3120d8f7-bba5-4595-adf4-b1f7469bc860 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/60544374-5c3b-436d-b94f-53231e097225 HTTP/1.1" status: 204 len: 168 time: 0.1306024 Sep 01 17:02:41.962363 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3120d8f7-bba5-4595-adf4-b1f7469bc860 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60544374-5c3b-436d-b94f-53231e097225,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:42.512562 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0192105f-a847-4489-9de8-f32d9eec2ee3 req-c5dad02a-476d-48ba-ae5c-285675b3911a tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:42.514090 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0192105f-a847-4489-9de8-f32d9eec2ee3 req-c5dad02a-476d-48ba-ae5c-285675b3911a tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 945 time: 0.0491033 Sep 01 17:02:42.554629 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0192105f-a847-4489-9de8-f32d9eec2ee3 req-2f9efecc-dcb4-4a25-b9b1-0cf7b9428406 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0345526 Sep 01 17:02:43.710954 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b569d2c-b51f-4243-9fd1-cfd207ea4a88 req-7944726b-f4c8-4c01-9422-bc9f405bcf1e tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:43.710954 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6b569d2c-b51f-4243-9fd1-cfd207ea4a88 req-7944726b-f4c8-4c01-9422-bc9f405bcf1e tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 945 time: 0.0696974 Sep 01 17:02:43.749224 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6b569d2c-b51f-4243-9fd1-cfd207ea4a88 req-703d6958-d168-4ec3-9a82-79a0a997e3f6 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323899 Sep 01 17:02:44.472284 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3579ec1-97a0-49b5-bb7c-5da9ff53df3a req-63c91645-c2f2-40fa-81c1-14f4b6aa4dd1 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:02:44.473853 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a3579ec1-97a0-49b5-bb7c-5da9ff53df3a req-63c91645-c2f2-40fa-81c1-14f4b6aa4dd1 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.69 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 945 time: 0.0505886 Sep 01 17:02:44.581110 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-a3579ec1-97a0-49b5-bb7c-5da9ff53df3a req-5b92efe6-83df-463a-8e73-a7e674705c9c tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Deleting port 7d758c28-5119-4575-8aae-fa9c017e56ad {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:02:44.581511 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a3579ec1-97a0-49b5-bb7c-5da9ff53df3a req-5b92efe6-83df-463a-8e73-a7e674705c9c tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:44.666791 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-a3579ec1-97a0-49b5-bb7c-5da9ff53df3a req-5b92efe6-83df-463a-8e73-a7e674705c9c tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] For port 7d758c28-5119-4575-8aae-fa9c017e56ad, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=7d758c28-5119-4575-8aae-fa9c017e56ad,segment=NetworkSegment(908c9756-53a1-4c99-846c-262c66bbb074),segment_id=908c9756-53a1-4c99-846c-262c66bbb074)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:02:44.667152 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a3579ec1-97a0-49b5-bb7c-5da9ff53df3a req-5b92efe6-83df-463a-8e73-a7e674705c9c tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:44.680268 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-a3579ec1-97a0-49b5-bb7c-5da9ff53df3a req-5b92efe6-83df-463a-8e73-a7e674705c9c tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Calling delete_port for 7d758c28-5119-4575-8aae-fa9c017e56ad owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:02:44.815985 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a3579ec1-97a0-49b5-bb7c-5da9ff53df3a req-5b92efe6-83df-463a-8e73-a7e674705c9c tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:44.828328 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['7d758c28-5119-4575-8aae-fa9c017e56ad'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:02:44.852224 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b92efe6-83df-463a-8e73-a7e674705c9c tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Pushing event deleted for resources: {'Port': ['ID=7d758c28-5119-4575-8aae-fa9c017e56ad,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:44.874751 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9bb94b1b-012a-414f-bd69-8965cf188673 req-e4b567c0-d1bc-4d7d-9e4b-c7448692804d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=0665ed54-9cf9-4fb0-8ac8-e671808548d1 HTTP/1.1" status: 200 len: 210 time: 0.0521114 Sep 01 17:02:44.911644 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-a3579ec1-97a0-49b5-bb7c-5da9ff53df3a req-5b92efe6-83df-463a-8e73-a7e674705c9c tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] No DVR routers for this DVR port 7d758c28-5119-4575-8aae-fa9c017e56ad on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:02:44.914293 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a3579ec1-97a0-49b5-bb7c-5da9ff53df3a req-5b92efe6-83df-463a-8e73-a7e674705c9c tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:44.916358 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a3579ec1-97a0-49b5-bb7c-5da9ff53df3a req-5b92efe6-83df-463a-8e73-a7e674705c9c tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.69 "DELETE /v2.0/ports/7d758c28-5119-4575-8aae-fa9c017e56ad HTTP/1.1" status: 204 len: 173 time: 0.4349070 Sep 01 17:02:44.916863 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0665ed54-9cf9-4fb0-8ac8-e671808548d1', 'name': 'network-vif-deleted', 'tag': '7d758c28-5119-4575-8aae-fa9c017e56ad'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:02:44.919108 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bb050a63-eedf-40fb-8ace-075b7489b36a" -d '{"events": [{"server_uuid": "0665ed54-9cf9-4fb0-8ac8-e671808548d1", "name": "network-vif-deleted", "tag": "7d758c28-5119-4575-8aae-fa9c017e56ad"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:02:44.959622 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:02:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-70a101b1-662c-4674-9c00-44f27f80b2c6 x-openstack-request-id: req-70a101b1-662c-4674-9c00-44f27f80b2c6 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:02:44.960511 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0665ed54-9cf9-4fb0-8ac8-e671808548d1", "name": "network-vif-deleted", "tag": "7d758c28-5119-4575-8aae-fa9c017e56ad", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:02:44.960511 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-70a101b1-662c-4674-9c00-44f27f80b2c6 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:02:44.960740 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0665ed54-9cf9-4fb0-8ac8-e671808548d1', 'name': 'network-vif-deleted', 'tag': '7d758c28-5119-4575-8aae-fa9c017e56ad', 'status': 'completed', 'code': 200} Sep 01 17:02:46.936039 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 58034) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:47.037484 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1cf0e72b-a90f-4d53-adb1-519325226f05 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:47.124304 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1cf0e72b-a90f-4d53-adb1-519325226f05 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:47.128586 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1cf0e72b-a90f-4d53-adb1-519325226f05 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:47.166411 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-1cf0e72b-a90f-4d53-adb1-519325226f05 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=4287b67385cf4f91aaa91599e8de9669&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2293277 Sep 01 17:02:47.167237 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf0e72b-a90f-4d53-adb1-519325226f05 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ad2e8331-af4f-45ca-972a-888c708070c6,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:47.169953 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58040) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:47.221938 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-d2eeb3bb-7e52-462b-822e-0c4053529141 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:47.242286 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-d2eeb3bb-7e52-462b-822e-0c4053529141 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:47.289945 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-d2eeb3bb-7e52-462b-822e-0c4053529141 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:47.292682 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-d2eeb3bb-7e52-462b-822e-0c4053529141 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:47.293847 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-d2eeb3bb-7e52-462b-822e-0c4053529141 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/ad2e8331-af4f-45ca-972a-888c708070c6 HTTP/1.1" status: 204 len: 168 time: 0.1225419 Sep 01 17:02:47.301955 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2eeb3bb-7e52-462b-822e-0c4053529141 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad2e8331-af4f-45ca-972a-888c708070c6,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:47.558875 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 58052) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:47.572521 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-47bb3823-c58d-4d9d-9f56-8cca789493f4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:47.591899 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:02:47.662377 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-47bb3823-c58d-4d9d-9f56-8cca789493f4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:47.665939 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-47bb3823-c58d-4d9d-9f56-8cca789493f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:47.703526 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-47bb3823-c58d-4d9d-9f56-8cca789493f4 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=5db73f33163140ee8aa138eadcf99da3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1434972 Sep 01 17:02:47.704588 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47bb3823-c58d-4d9d-9f56-8cca789493f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=02b83fb4-8a7b-47c0-ad54-9f2204db7db6,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:47.706598 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58054) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:02:47.757982 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3661a602-a6fe-4855-9da0-bd0369b8afa7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:47.779752 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3661a602-a6fe-4855-9da0-bd0369b8afa7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:47.825738 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3661a602-a6fe-4855-9da0-bd0369b8afa7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:47.828283 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3661a602-a6fe-4855-9da0-bd0369b8afa7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:47.829448 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-3661a602-a6fe-4855-9da0-bd0369b8afa7 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/02b83fb4-8a7b-47c0-ad54-9f2204db7db6 HTTP/1.1" status: 204 len: 168 time: 0.1221397 Sep 01 17:02:47.837868 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3661a602-a6fe-4855-9da0-bd0369b8afa7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=02b83fb4-8a7b-47c0-ad54-9f2204db7db6,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:02:49.098844 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 7d758c28-5119-4575-8aae-fa9c017e56ad no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:02:49.120770 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: 7d758c28-5119-4575-8aae-fa9c017e56ad {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:02:49.121112 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 7d758c28-5119-4575-8aae-fa9c017e56ad not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:02:51.235073 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-b8a62c3f-1833-4a25-9b37-704adff6065b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:53.756767 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:53.775211 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-09f463df-276d-4e9d-b5a7-ad461efadf32 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:54.904130 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:56.503039 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:02:56.542081 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:00.019574 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-fd88a6c3-7ca4-4d75-a33b-b821e7f56244 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:00.020973 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-fd88a6c3-7ca4-4d75-a33b-b821e7f56244 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/networks?id=50a57de3-5738-4399-9f1b-3d7d294c86dc HTTP/1.1" status: 200 len: 813 time: 0.1017158 Sep 01 17:03:00.036883 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-d06732b4-1f20-4c24-a9a3-54602bf20bee tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/quotas/7ddcba698dfe424a89ef6b0fa2e10ae6 HTTP/1.1" status: 200 len: 375 time: 0.0099707 Sep 01 17:03:00.069122 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-743625d9-4ac6-489b-951b-aeb070ef2d88 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=7ddcba698dfe424a89ef6b0fa2e10ae6&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0270443 Sep 01 17:03:00.165925 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-246b19ab-8532-4a14-a4ad-9e4cd1019814 service neutron] 10.222.0.67 "GET /v2.0/networks/50a57de3-5738-4399-9f1b-3d7d294c86dc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0899670 Sep 01 17:03:00.259563 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-20ac43a3-f615-4349-bd75-8f2f30e0437c service neutron] 10.222.0.67 "GET /v2.0/networks/50a57de3-5738-4399-9f1b-3d7d294c86dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0885375 Sep 01 17:03:00.465493 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cb1cc509-68a0-4041-b5e7-794ff137feda req-f20d0189-7690-4df4-8b36-2463f7cb0ba9 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 210 time: 0.0580177 Sep 01 17:03:00.584756 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58332) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:00.700093 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17673ee9-190f-4503-880f-939fec31721f req-4c229f0b-118a-4bcd-97e0-117e609f81ce tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:00.710043 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-17673ee9-190f-4503-880f-939fec31721f req-4c229f0b-118a-4bcd-97e0-117e609f81ce tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 946 time: 0.0731995 Sep 01 17:03:00.746503 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-35c327b8-6db5-43be-8853-fae7d60772ca admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:00.778612 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-17673ee9-190f-4503-880f-939fec31721f req-0c0bd96a-4c06-4652-bc53-14fc445ff365 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0660479 Sep 01 17:03:00.867518 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-35c327b8-6db5-43be-8853-fae7d60772ca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:00.872891 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-35c327b8-6db5-43be-8853-fae7d60772ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:00.915591 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-35c327b8-6db5-43be-8853-fae7d60772ca admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=c662dca0c267461e8213346cfb846350&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3267808 Sep 01 17:03:00.915591 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35c327b8-6db5-43be-8853-fae7d60772ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fdb83c0-cf3c-49f5-91cb-942ec6e24e86,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:00.916624 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 58354) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:00.982606 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f2ce3651-f29c-4823-bf1b-45807645de89 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:01.004854 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f2ce3651-f29c-4823-bf1b-45807645de89 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:01.055317 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f2ce3651-f29c-4823-bf1b-45807645de89 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:01.058028 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f2ce3651-f29c-4823-bf1b-45807645de89 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:01.059301 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-f2ce3651-f29c-4823-bf1b-45807645de89 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/2fdb83c0-cf3c-49f5-91cb-942ec6e24e86 HTTP/1.1" status: 204 len: 168 time: 0.1421673 Sep 01 17:03:01.069248 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2ce3651-f29c-4823-bf1b-45807645de89 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fdb83c0-cf3c-49f5-91cb-942ec6e24e86,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:01.330343 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 58360) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:01.343681 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3147cd21-a5ef-46db-af6a-a016ee4fafec admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:01.444270 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3147cd21-a5ef-46db-af6a-a016ee4fafec admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:01.454454 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3147cd21-a5ef-46db-af6a-a016ee4fafec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:01.541435 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58364) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:01.542084 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-3147cd21-a5ef-46db-af6a-a016ee4fafec admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=f16af7c13475435eaca8e2b298921f89&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2099900 Sep 01 17:03:01.550711 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3147cd21-a5ef-46db-af6a-a016ee4fafec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=402a0478-c3f0-4580-b251-ed8b42b930b3,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:01.581939 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-1d468c0f-d0a9-4625-8f97-a7cc34f54684 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:01.583457 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-1d468c0f-d0a9-4625-8f97-a7cc34f54684 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.69 "GET /v2.0/networks?id=50a57de3-5738-4399-9f1b-3d7d294c86dc HTTP/1.1" status: 200 len: 813 time: 0.1529391 Sep 01 17:03:01.601872 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-44be897f-e3c6-44ab-9ef0-e2f7703ca94d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Request body: {'port': {'device_id': 'c57e6fc1-fdb1-405e-9693-6d002580586e', 'network_id': '50a57de3-5738-4399-9f1b-3d7d294c86dc', 'admin_state_up': True, 'tenant_id': '7ddcba698dfe424a89ef6b0fa2e10ae6'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:01.612102 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ed32a219-56c6-44a8-9515-69c325a117a3 req-298929e7-217c-410e-9dcb-332156f1f856 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 210 time: 0.0383394 Sep 01 17:03:01.621198 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7367f6fd-2871-4c4b-b74b-b02a1d2c44ec admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:01.647966 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7367f6fd-2871-4c4b-b74b-b02a1d2c44ec admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:01.699634 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7367f6fd-2871-4c4b-b74b-b02a1d2c44ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:01.702395 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7367f6fd-2871-4c4b-b74b-b02a1d2c44ec admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:01.707094 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-7367f6fd-2871-4c4b-b74b-b02a1d2c44ec admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/402a0478-c3f0-4580-b251-ed8b42b930b3 HTTP/1.1" status: 204 len: 168 time: 0.1602874 Sep 01 17:03:01.713211 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7367f6fd-2871-4c4b-b74b-b02a1d2c44ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=402a0478-c3f0-4580-b251-ed8b42b930b3,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:01.724927 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-44be897f-e3c6-44ab-9ef0-e2f7703ca94d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Made reservation on behalf of 7ddcba698dfe424a89ef6b0fa2e10ae6 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:03:01.729267 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-44be897f-e3c6-44ab-9ef0-e2f7703ca94d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:01.860953 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-44be897f-e3c6-44ab-9ef0-e2f7703ca94d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Allocated IP 172.20.0.2 (50a57de3-5738-4399-9f1b-3d7d294c86dc/666c0d30-db52-4561-9b93-97a824a51a0d/efd56e04-713d-49e6-9f93-b6c33f23c45b) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:03:01.928660 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468d3c48-a661-4bcd-9464-e36a0ef44e70 req-a0883740-51ba-45d2-bfa1-cfe522e9d618 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:01.930304 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-468d3c48-a661-4bcd-9464-e36a0ef44e70 req-a0883740-51ba-45d2-bfa1-cfe522e9d618 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 946 time: 0.0579097 Sep 01 17:03:01.985994 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-468d3c48-a661-4bcd-9464-e36a0ef44e70 req-71807775-0f7d-45c6-b9f9-1244ebd26aea tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489874 Sep 01 17:03:02.019306 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-44be897f-e3c6-44ab-9ef0-e2f7703ca94d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:02.077692 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-44be897f-e3c6-44ab-9ef0-e2f7703ca94d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:02.124405 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-44be897f-e3c6-44ab-9ef0-e2f7703ca94d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Network 50a57de3-5738-4399-9f1b-3d7d294c86dc is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:03:02.127908 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-44be897f-e3c6-44ab-9ef0-e2f7703ca94d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:02.130588 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-44be897f-e3c6-44ab-9ef0-e2f7703ca94d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:03:02.183610 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44be897f-e3c6-44ab-9ef0-e2f7703ca94d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Pushing event updated for resources: {'Port': ['ID=efd56e04-713d-49e6-9f93-b6c33f23c45b,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:02.201511 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-44be897f-e3c6-44ab-9ef0-e2f7703ca94d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:02.202168 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-44be897f-e3c6-44ab-9ef0-e2f7703ca94d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:02.218480 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-44be897f-e3c6-44ab-9ef0-e2f7703ca94d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6206625 Sep 01 17:03:02.232638 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Request body: {'port': {'device_id': 'c57e6fc1-fdb1-405e-9693-6d002580586e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:02.302169 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:02.566963 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id efd56e04-713d-49e6-9f93-b6c33f23c45b {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:03:02.574177 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:02.586550 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Transition to ACTIVE for port object efd56e04-713d-49e6-9f93-b6c33f23c45b will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:02.589854 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:02.657886 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Pushing event updated for resources: {'Port': ['ID=efd56e04-713d-49e6-9f93-b6c33f23c45b,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:02.736195 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae858f97-634e-4e62-a714-8f7138ad5032 req-138d2151-bdcd-4c94-b898-43b2099e38e5 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:02.739287 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ae858f97-634e-4e62-a714-8f7138ad5032 req-138d2151-bdcd-4c94-b898-43b2099e38e5 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 943 time: 0.0555425 Sep 01 17:03:02.750040 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b60e6ce1-8e72-418b-b717-8703db0fcca5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:02.751674 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b60e6ce1-8e72-418b-b717-8703db0fcca5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.69 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 946 time: 0.0910766 Sep 01 17:03:02.769135 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Attempting to bind port efd56e04-713d-49e6-9f93-b6c33f23c45b on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:03:02.770197 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Attempting to bind port efd56e04-713d-49e6-9f93-b6c33f23c45b by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': '908c9756-53a1-4c99-846c-262c66bbb074', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '50a57de3-5738-4399-9f1b-3d7d294c86dc'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:03:02.770197 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Attempting to bind port efd56e04-713d-49e6-9f93-b6c33f23c45b on network 50a57de3-5738-4399-9f1b-3d7d294c86dc {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:03:02.781821 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ae858f97-634e-4e62-a714-8f7138ad5032 req-eb2590d1-f9fc-4396-8c72-e0a78f535a79 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355334 Sep 01 17:03:02.793100 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Port efd56e04-713d-49e6-9f93-b6c33f23c45b on network 50a57de3-5738-4399-9f1b-3d7d294c86dc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:03:02.793459 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Attempting to bind port efd56e04-713d-49e6-9f93-b6c33f23c45b on network 50a57de3-5738-4399-9f1b-3d7d294c86dc {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:03:02.805659 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 2, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:03:02.806001 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Checking segment: {'id': '908c9756-53a1-4c99-846c-262c66bbb074', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '50a57de3-5738-4399-9f1b-3d7d294c86dc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:03:02.806391 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Bound using segment: {'id': '908c9756-53a1-4c99-846c-262c66bbb074', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '50a57de3-5738-4399-9f1b-3d7d294c86dc'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:03:02.806831 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Bound port: efd56e04-713d-49e6-9f93-b6c33f23c45b, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '908c9756-53a1-4c99-846c-262c66bbb074', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '50a57de3-5738-4399-9f1b-3d7d294c86dc'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:03:02.807194 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:02.915123 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] For port efd56e04-713d-49e6-9f93-b6c33f23c45b, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:03:02.918331 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Deleting port f3cd3382-a1bb-4f12-b1b1-64bd000296fb {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:03:02.918740 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:02.923559 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] For port efd56e04-713d-49e6-9f93-b6c33f23c45b, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=efd56e04-713d-49e6-9f93-b6c33f23c45b,segment=NetworkSegment(908c9756-53a1-4c99-846c-262c66bbb074),segment_id=908c9756-53a1-4c99-846c-262c66bbb074)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:03:02.936160 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:03.000729 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:03.001360 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:03.003022 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] 10.222.0.69 "PUT /v2.0/ports/efd56e04-713d-49e6-9f93-b6c33f23c45b HTTP/1.1" status: 200 len: 1093 time: 0.7754369 Sep 01 17:03:03.009678 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c57e6fc1-fdb1-405e-9693-6d002580586e', 'tag': 'efd56e04-713d-49e6-9f93-b6c33f23c45b'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:03.011947 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-563f455a-4ca2-4097-8202-9ad439b32c9c" -d '{"events": [{"name": "network-changed", "server_uuid": "c57e6fc1-fdb1-405e-9693-6d002580586e", "tag": "efd56e04-713d-49e6-9f93-b6c33f23c45b"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:03.061306 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbe238a-3f0b-4c29-8058-13753083bc2e service neutron] Pushing event updated for resources: {'Port': ['ID=efd56e04-713d-49e6-9f93-b6c33f23c45b,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:03.069434 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e5c19ef6-c515-47ef-99e2-384fc13a8fde x-openstack-request-id: req-e5c19ef6-c515-47ef-99e2-384fc13a8fde {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:03.069734 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c57e6fc1-fdb1-405e-9693-6d002580586e", "tag": "efd56e04-713d-49e6-9f93-b6c33f23c45b", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:03.069994 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-e5c19ef6-c515-47ef-99e2-384fc13a8fde {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:03.070385 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c57e6fc1-fdb1-405e-9693-6d002580586e', 'tag': 'efd56e04-713d-49e6-9f93-b6c33f23c45b', 'status': 'completed', 'code': 200} Sep 01 17:03:03.120399 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] For port f3cd3382-a1bb-4f12-b1b1-64bd000296fb, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:03.120776 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:03.157255 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1409d19-984a-4331-84e1-e9da78ad2371 req-accff4ec-cd0f-4d02-8e71-6e91195918e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:03.162276 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b1409d19-984a-4331-84e1-e9da78ad2371 req-accff4ec-cd0f-4d02-8e71-6e91195918e7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 946 time: 0.0576007 Sep 01 17:03:03.198524 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-b9c85e34-6ef3-49f0-afcf-b277d6d079fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:03.199923 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b1409d19-984a-4331-84e1-e9da78ad2371 req-1e4c00bf-02c1-493b-a0b5-a0486ac948ac tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5fc77e84-de9d-44e5-b947-11c478e5af40&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0342071 Sep 01 17:03:03.200032 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-b9c85e34-6ef3-49f0-afcf-b277d6d079fd service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7ddcba698dfe424a89ef6b0fa2e10ae6&device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 1096 time: 0.1202238 Sep 01 17:03:03.268033 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-298dc359-a88e-4b0c-a8ca-9b1afdcbc784 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=efd56e04-713d-49e6-9f93-b6c33f23c45b HTTP/1.1" status: 200 len: 217 time: 0.0533712 Sep 01 17:03:03.393987 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-529161de-d27c-4853-a865-ef45ce7999dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:03.395500 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-529161de-d27c-4853-a865-ef45ce7999dd service neutron] 10.222.0.69 "GET /v2.0/subnets?id=666c0d30-db52-4561-9b93-97a824a51a0d HTTP/1.1" status: 200 len: 853 time: 0.1168606 Sep 01 17:03:03.477612 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-155705e7-fa9c-45a3-8023-9ed8bbb20a21 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=50a57de3-5738-4399-9f1b-3d7d294c86dc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0459971 Sep 01 17:03:03.799018 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for floatingip, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:03.799437 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:03.799768 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.l3_db [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Floating IP 8d24ba55-ba66-4fe7-84c7-fbf7569b66f7 disassociated. External IP: 172.27.1.60, port: f3cd3382-a1bb-4f12-b1b1-64bd000296fb. Sep 01 17:03:03.800466 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Calling delete_port for f3cd3382-a1bb-4f12-b1b1-64bd000296fb owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:03:03.806963 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58464) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:03.901159 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-76f716f6-1ce8-4d4d-a49f-4eae943f6d7f service neutron] 10.222.0.69 "GET /v2.0/networks/50a57de3-5738-4399-9f1b-3d7d294c86dc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4064140 Sep 01 17:03:03.910961 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b66c18c-f168-4df9-812f-6d79508931f9 req-7b3ff3eb-80eb-4557-89f0-29c834bfd863 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:03.912470 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6b66c18c-f168-4df9-812f-6d79508931f9 req-7b3ff3eb-80eb-4557-89f0-29c834bfd863 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 943 time: 0.0525312 Sep 01 17:03:03.932597 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a474009-661c-472a-9719-4ac3b08c5ef8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:03.977808 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6b66c18c-f168-4df9-812f-6d79508931f9 req-5fe2890e-1e05-4037-be9c-8c52a2552c59 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576587 Sep 01 17:03:04.043483 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d7b22a58-8e1a-47fd-8029-05401470fd49 req-19e60260-ad88-422c-8a6b-703f978feacd service neutron] 10.222.0.69 "GET /v2.0/networks/50a57de3-5738-4399-9f1b-3d7d294c86dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1340008 Sep 01 17:03:04.044609 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.054957 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a474009-661c-472a-9719-4ac3b08c5ef8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.059508 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a474009-661c-472a-9719-4ac3b08c5ef8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.077644 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event deleted for resources: {'Port': ['ID=f3cd3382-a1bb-4f12-b1b1-64bd000296fb,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:04.106087 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-2a474009-661c-472a-9719-4ac3b08c5ef8 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=171f7009aa48464ebff4f1084d92e252&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2980478 Sep 01 17:03:04.106932 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a474009-661c-472a-9719-4ac3b08c5ef8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d2dfb33-0804-47c5-a536-4de805f40ec7,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:04.109160 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58470) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:04.162312 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7238deb7-26d5-4285-b4fd-881e7c1f3f95 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.184618 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7238deb7-26d5-4285-b4fd-881e7c1f3f95 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.213965 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-563f455a-4ca2-4097-8202-9ad439b32c9c req-ff2caada-bb06-4ea2-8603-d37f9aaffeab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:04.215483 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-563f455a-4ca2-4097-8202-9ad439b32c9c req-ff2caada-bb06-4ea2-8603-d37f9aaffeab service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=7ddcba698dfe424a89ef6b0fa2e10ae6&device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 1096 time: 0.0885122 Sep 01 17:03:04.233692 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7238deb7-26d5-4285-b4fd-881e7c1f3f95 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.236324 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-7238deb7-26d5-4285-b4fd-881e7c1f3f95 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.241190 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-7238deb7-26d5-4285-b4fd-881e7c1f3f95 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/3d2dfb33-0804-47c5-a536-4de805f40ec7 HTTP/1.1" status: 204 len: 168 time: 0.1310661 Sep 01 17:03:04.253107 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7238deb7-26d5-4285-b4fd-881e7c1f3f95 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d2dfb33-0804-47c5-a536-4de805f40ec7,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:04.286645 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:03:04.331553 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5d485bc9-09ef-4a42-868f-9035e803db2a req-d298b968-2717-4e60-b0c5-522786eb7bd9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=0678fbe1-e92f-49b6-93cd-5babcfc2de18 HTTP/1.1" status: 200 len: 210 time: 0.0303633 Sep 01 17:03:04.389209 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-563f455a-4ca2-4097-8202-9ad439b32c9c req-cc69718c-df8e-4d95-aa30-98c086309370 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:04.390769 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-563f455a-4ca2-4097-8202-9ad439b32c9c req-cc69718c-df8e-4d95-aa30-98c086309370 service neutron] 10.222.0.69 "GET /v2.0/networks?id=50a57de3-5738-4399-9f1b-3d7d294c86dc HTTP/1.1" status: 200 len: 914 time: 0.1657605 Sep 01 17:03:04.463895 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-563f455a-4ca2-4097-8202-9ad439b32c9c req-edae0af6-9f9f-420e-902b-14fab39ab80f service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=efd56e04-713d-49e6-9f93-b6c33f23c45b HTTP/1.1" status: 200 len: 217 time: 0.0432110 Sep 01 17:03:04.510424 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:03:04.521870 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9afd826-0158-47a6-8379-429ea57512fb None None] Sync routers for ids ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:03:04.533280 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9afd826-0158-47a6-8379-429ea57512fb None None] Routers {'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:04.534439 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-d9afd826-0158-47a6-8379-429ea57512fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:02:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:04.553137 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58478) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:04.560644 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] No DVR routers for this DVR port f3cd3382-a1bb-4f12-b1b1-64bd000296fb on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:03:04.564644 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.567392 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-dbd3e4fc-c96a-47af-94ec-f677af0a1c54 req-b916d1aa-14e5-402e-bb94-26c626596e9e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.69 "DELETE /v2.0/ports/f3cd3382-a1bb-4f12-b1b1-64bd000296fb HTTP/1.1" status: 204 len: 173 time: 1.8063529 Sep 01 17:03:04.568270 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-85eccd17-4ec8-4404-8df3-2a20913b700a admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.569211 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-563f455a-4ca2-4097-8202-9ad439b32c9c req-dee11f2f-5f8b-4cf3-a18e-3976a519e394 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:04.570655 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-563f455a-4ca2-4097-8202-9ad439b32c9c req-dee11f2f-5f8b-4cf3-a18e-3976a519e394 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=666c0d30-db52-4561-9b93-97a824a51a0d HTTP/1.1" status: 200 len: 853 time: 0.0979307 Sep 01 17:03:04.613546 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-563f455a-4ca2-4097-8202-9ad439b32c9c req-c79c8585-d884-4703-a919-90001f72ff45 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=50a57de3-5738-4399-9f1b-3d7d294c86dc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0333505 Sep 01 17:03:04.666184 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-d9afd826-0158-47a6-8379-429ea57512fb None None] Set router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:04.695367 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-85eccd17-4ec8-4404-8df3-2a20913b700a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.700831 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-85eccd17-4ec8-4404-8df3-2a20913b700a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.744818 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-85eccd17-4ec8-4404-8df3-2a20913b700a admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=7c212adf51a943f7b2117f8327faddc4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1904597 Sep 01 17:03:04.747570 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 58482) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:04.757196 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85eccd17-4ec8-4404-8df3-2a20913b700a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3baae6c1-9e32-499d-8422-e655391bce10,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:04.775382 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-563f455a-4ca2-4097-8202-9ad439b32c9c req-3e3f0f06-87cd-49ca-961c-f78bbb58a306 service neutron] 10.222.0.69 "GET /v2.0/networks/50a57de3-5738-4399-9f1b-3d7d294c86dc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1539404 Sep 01 17:03:04.880597 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-debd8165-e969-4bf4-90b4-e6df63193c8b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.923792 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-debd8165-e969-4bf4-90b4-e6df63193c8b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.933010 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-563f455a-4ca2-4097-8202-9ad439b32c9c req-30171d6c-76f5-49a6-85b4-7e9a9373694e service neutron] 10.222.0.69 "GET /v2.0/networks/50a57de3-5738-4399-9f1b-3d7d294c86dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1454370 Sep 01 17:03:04.937113 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-d9afd826-0158-47a6-8379-429ea57512fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:39Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:04.983518 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-debd8165-e969-4bf4-90b4-e6df63193c8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.986283 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-debd8165-e969-4bf4-90b4-e6df63193c8b admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:04.990265 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-debd8165-e969-4bf4-90b4-e6df63193c8b admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/3baae6c1-9e32-499d-8422-e655391bce10 HTTP/1.1" status: 204 len: 168 time: 0.2371159 Sep 01 17:03:04.996368 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-debd8165-e969-4bf4-90b4-e6df63193c8b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3baae6c1-9e32-499d-8422-e655391bce10,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:05.006731 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9afd826-0158-47a6-8379-429ea57512fb None None] Checking router: e95cfaf6-7dbf-4e42-af63-5c1ea40c693e for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:03:05.050834 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9afd826-0158-47a6-8379-429ea57512fb None None] Routers {'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:05.051723 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-d9afd826-0158-47a6-8379-429ea57512fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:02:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:05.072211 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'name': 'network-vif-deleted', 'tag': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:05.075257 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-acc02e81-0e8f-4e9b-8ecb-5c7570f57d21" -d '{"events": [{"server_uuid": "0678fbe1-e92f-49b6-93cd-5babcfc2de18", "name": "network-vif-deleted", "tag": "f3cd3382-a1bb-4f12-b1b1-64bd000296fb"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:05.143600 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1924f946-2c80-4954-a3b1-6d668b9d631b x-openstack-request-id: req-1924f946-2c80-4954-a3b1-6d668b9d631b {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:05.144233 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0678fbe1-e92f-49b6-93cd-5babcfc2de18", "name": "network-vif-deleted", "tag": "f3cd3382-a1bb-4f12-b1b1-64bd000296fb", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:05.144233 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-1924f946-2c80-4954-a3b1-6d668b9d631b {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:05.144514 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0678fbe1-e92f-49b6-93cd-5babcfc2de18', 'name': 'network-vif-deleted', 'tag': 'f3cd3382-a1bb-4f12-b1b1-64bd000296fb', 'status': 'completed', 'code': 200} Sep 01 17:03:05.177980 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4872201b-5dd4-4ce2-9912-f482da6ddcc3 req-3a282d7f-48a8-456e-a69b-11697744a292 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:05.188183 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4872201b-5dd4-4ce2-9912-f482da6ddcc3 req-3a282d7f-48a8-456e-a69b-11697744a292 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 943 time: 0.0768421 Sep 01 17:03:05.210211 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-d9afd826-0158-47a6-8379-429ea57512fb None None] Set router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:05.255215 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4872201b-5dd4-4ce2-9912-f482da6ddcc3 req-8939251d-857a-4425-9379-8f36226688ce tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659087 Sep 01 17:03:05.433510 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 58506) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:05.459842 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-d9afd826-0158-47a6-8379-429ea57512fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:39Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:05.495824 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-48ea04f3-de2c-4456-9974-52f38224f783 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:05.497525 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9afd826-0158-47a6-8379-429ea57512fb None None] The sync data for ids ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'] in dv-cinder-799668-16-iscsi is: [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:39Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:03:05.536347 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-48ea04f3-de2c-4456-9974-52f38224f783 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:05.590187 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-48ea04f3-de2c-4456-9974-52f38224f783 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:05.593944 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-48ea04f3-de2c-4456-9974-52f38224f783 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:05.598192 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58512) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:05.598372 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-48ea04f3-de2c-4456-9974-52f38224f783 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "DELETE /v2.0/security-groups/5fc77e84-de9d-44e5-b947-11c478e5af40 HTTP/1.1" status: 204 len: 168 time: 0.1637626 Sep 01 17:03:05.609682 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48ea04f3-de2c-4456-9974-52f38224f783 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5fc77e84-de9d-44e5-b947-11c478e5af40,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:05.616948 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.api.v2.resource [None req-f1b503ad-6ff4-4d63-91f3-3730e0a07d07 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] show failed (client error): The resource could not be found. Sep 01 17:03:05.618376 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-f1b503ad-6ff4-4d63-91f3-3730e0a07d07 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups/5fc77e84-de9d-44e5-b947-11c478e5af40 HTTP/1.1" status: 404 len: 347 time: 0.0187678 Sep 01 17:03:05.631874 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58514) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:05.773993 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-97bc328b-a5b4-4b61-900c-c43b445ee1d7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Deleting port 016c7291-49f2-4c8d-ad7e-c4b7f9a9bba2 {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:03:05.774348 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-97bc328b-a5b4-4b61-900c-c43b445ee1d7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:05.858233 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-97bc328b-a5b4-4b61-900c-c43b445ee1d7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:05.858560 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-97bc328b-a5b4-4b61-900c-c43b445ee1d7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:05.877055 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-97bc328b-a5b4-4b61-900c-c43b445ee1d7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Calling delete_port for 016c7291-49f2-4c8d-ad7e-c4b7f9a9bba2 owned by network:floatingip {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:03:05.931814 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f59c40c5-7437-43fd-ba18-c8f648d851d4 None None] New status for floating IP 8d24ba55-ba66-4fe7-84c7-fbf7569b66f7: DOWN {{(pid=93838) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:03:06.081806 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.db.api [None req-f59c40c5-7437-43fd-ba18-c8f648d851d4 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=93838) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Sep 01 17:03:06.082150 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG oslo_db.api [None req-f59c40c5-7437-43fd-ba18-c8f648d851d4 None None] Performing DB retry for function neutron.api.rpc.handlers.l3_rpc.L3RpcCallback.update_floatingip_statuses {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Sep 01 17:03:06.083463 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-97bc328b-a5b4-4b61-900c-c43b445ee1d7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.116559 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97bc328b-a5b4-4b61-900c-c43b445ee1d7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event deleted for resources: {'Port': ['ID=016c7291-49f2-4c8d-ad7e-c4b7f9a9bba2,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:06.177546 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-97bc328b-a5b4-4b61-900c-c43b445ee1d7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for floatingip, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.180143 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-97bc328b-a5b4-4b61-900c-c43b445ee1d7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.181292 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-97bc328b-a5b4-4b61-900c-c43b445ee1d7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "DELETE /v2.0/floatingips/8d24ba55-ba66-4fe7-84c7-fbf7569b66f7 HTTP/1.1" status: 204 len: 168 time: 0.5480027 Sep 01 17:03:06.365103 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c5fdc87-8bb4-4454-9e03-1aad7eec068c req-c58d6cb5-9eb5-4636-bdec-e299d74a6eeb tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:06.366973 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1c5fdc87-8bb4-4454-9e03-1aad7eec068c req-c58d6cb5-9eb5-4636-bdec-e299d74a6eeb tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 943 time: 0.0532451 Sep 01 17:03:06.432338 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1c5fdc87-8bb4-4454-9e03-1aad7eec068c req-32903445-4c93-470f-9956-b5d34023927c tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585606 Sep 01 17:03:06.541517 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58540) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:06.546498 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-ad461ce9-6d30-4a2b-90d5-e1753a56f330 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1189410355', 'description': 'tempest-description--988557421'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:06.570296 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ad461ce9-6d30-4a2b-90d5-e1753a56f330 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.583724 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f59c40c5-7437-43fd-ba18-c8f648d851d4 None None] New status for floating IP 8d24ba55-ba66-4fe7-84c7-fbf7569b66f7: DOWN {{(pid=93838) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:03:06.660454 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ad461ce9-6d30-4a2b-90d5-e1753a56f330 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.664693 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ad461ce9-6d30-4a2b-90d5-e1753a56f330 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.695276 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ad461ce9-6d30-4a2b-90d5-e1753a56f330 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.699101 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-ad461ce9-6d30-4a2b-90d5-e1753a56f330 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.1539190 Sep 01 17:03:06.699101 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad461ce9-6d30-4a2b-90d5-e1753a56f330 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5e077c29-f364-4757-85f6-20d583655da1,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:06.699481 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 58542) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:06.705536 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-340d7e70-c36d-4dd9-9650-d2b7fd0f22d9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Request body: {'security_group_rule': {'security_group_id': '5e077c29-f364-4757-85f6-20d583655da1', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:06.734253 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-340d7e70-c36d-4dd9-9650-d2b7fd0f22d9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.784632 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-340d7e70-c36d-4dd9-9650-d2b7fd0f22d9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.789097 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-340d7e70-c36d-4dd9-9650-d2b7fd0f22d9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.809721 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-340d7e70-c36d-4dd9-9650-d2b7fd0f22d9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e6756903-ca09-4681-be27-c47b81ad9c99,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:06.818129 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-340d7e70-c36d-4dd9-9650-d2b7fd0f22d9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.819326 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-340d7e70-c36d-4dd9-9650-d2b7fd0f22d9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1186686 Sep 01 17:03:06.822201 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58544) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:06.826837 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-b3a92a26-e676-4830-a3f8-745e3047521a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Request body: {'security_group_rule': {'security_group_id': '5e077c29-f364-4757-85f6-20d583655da1', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:06.855652 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b3a92a26-e676-4830-a3f8-745e3047521a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.915984 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b3a92a26-e676-4830-a3f8-745e3047521a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.920127 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b3a92a26-e676-4830-a3f8-745e3047521a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.934975 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a92a26-e676-4830-a3f8-745e3047521a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cf32c78c-636e-4d19-8978-b05b5f7c71f9,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:06.943758 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b3a92a26-e676-4830-a3f8-745e3047521a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:06.944947 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-b3a92a26-e676-4830-a3f8-745e3047521a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1217086 Sep 01 17:03:06.948217 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58548) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:06.952555 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Request body: {'floatingip': {'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:06.975266 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for floatingip, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:07.070983 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:07.176038 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Allocated IP 172.27.1.183 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/f68ae185-b6ef-446a-9f1b-9395fd040992) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:03:07.282629 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:07.323559 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:07.363072 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:03:07.365895 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:07.368222 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:03:07.391240 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event updated for resources: {'Port': ['ID=f68ae185-b6ef-446a-9f1b-9395fd040992,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:07.457189 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:07.491940 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:07.613061 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a184e714-130d-43e1-90e0-14c09f0590e7 req-f56d7668-985c-48de-a78d-f8d7a8f9d459 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:07.614561 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a184e714-130d-43e1-90e0-14c09f0590e7 req-f56d7668-985c-48de-a78d-f8d7a8f9d459 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 943 time: 0.1031079 Sep 01 17:03:07.673282 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a184e714-130d-43e1-90e0-14c09f0590e7 req-a9c31fb6-659c-4009-ab18-772ec11cf214 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528438 Sep 01 17:03:07.704402 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for port, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:07.709962 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6279726'] for port, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:07.779539 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event updated for resources: {'Port': ['ID=f68ae185-b6ef-446a-9f1b-9395fd040992,revision_number=2']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:07.791061 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:07.805565 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:07.806782 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-e9b2ea21-3a57-4e03-851a-dd24856745d3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.8576727 Sep 01 17:03:07.985623 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-0eb913d5-dd40-495a-a532-c5b326dd4f23 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?name=tempest-securitygroup--1189410355&fields=id&tenant_id=af7d370157f84ca198eb86180115a76f HTTP/1.1" status: 200 len: 267 time: 0.0320523 Sep 01 17:03:08.090366 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-25999833-8452-4d05-aaf8-73b88404c08d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:08.091814 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-25999833-8452-4d05-aaf8-73b88404c08d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/networks?id=2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 200 len: 816 time: 0.0993166 Sep 01 17:03:08.106538 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-391d7fa3-067f-4a13-9aae-55fb4d8fb7f6 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/quotas/af7d370157f84ca198eb86180115a76f HTTP/1.1" status: 200 len: 375 time: 0.0087829 Sep 01 17:03:08.131028 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device efd56e04-713d-49e6-9f93-b6c33f23c45b details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:03:08.136009 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device f3cd3382-a1bb-4f12-b1b1-64bd000296fb no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:03:08.163667 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-ffc4251b-ca59-4beb-8289-2cdfd2e9ae78 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0520291 Sep 01 17:03:08.166556 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: f3cd3382-a1bb-4f12-b1b1-64bd000296fb {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:03:08.167833 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device f3cd3382-a1bb-4f12-b1b1-64bd000296fb not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:03:08.253147 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port efd56e04-713d-49e6-9f93-b6c33f23c45b, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=efd56e04-713d-49e6-9f93-b6c33f23c45b,segment=NetworkSegment(908c9756-53a1-4c99-846c-262c66bbb074),segment_id=908c9756-53a1-4c99-846c-262c66bbb074)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:08.264064 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'efd56e04-713d-49e6-9f93-b6c33f23c45b', 'network_id': '50a57de3-5738-4399-9f1b-3d7d294c86dc', 'port_id': 'efd56e04-713d-49e6-9f93-b6c33f23c45b', 'mac_address': 'fa:16:3e:9f:cf:5e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 521, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '666c0d30-db52-4561-9b93-97a824a51a0d', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:03:08.303853 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:08.317934 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id efd56e04-713d-49e6-9f93-b6c33f23c45b {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:03:08.338247 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port efd56e04-713d-49e6-9f93-b6c33f23c45b, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=efd56e04-713d-49e6-9f93-b6c33f23c45b,segment=NetworkSegment(908c9756-53a1-4c99-846c-262c66bbb074),segment_id=908c9756-53a1-4c99-846c-262c66bbb074)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:08.342378 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:08.395754 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=efd56e04-713d-49e6-9f93-b6c33f23c45b,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:08.403646 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:08.404002 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:08.404348 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:08.404741 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:08.405078 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:08.405434 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:08.405771 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:08.406103 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:08.406515 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:08.406849 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:08.407183 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:08.407509 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:08.492732 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-10e5754c-71d1-4730-881f-35c09a94dae5 service neutron] 10.222.0.67 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3151512 Sep 01 17:03:08.588354 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-55af8383-fcf1-4793-b255-458988d01595 service neutron] 10.222.0.67 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893712 Sep 01 17:03:08.615646 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['efd56e04-713d-49e6-9f93-b6c33f23c45b'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:03:08.629317 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-00335689-d351-4b5f-bd43-38f95ee9d290 req-6483ed22-6550-4b3a-b47a-4e565defee16 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-561193278&fields=id&tenant_id=ccf739a17862469f9bbcedc5abe17cd1 HTTP/1.1" status: 200 len: 267 time: 0.0369639 Sep 01 17:03:08.710994 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00335689-d351-4b5f-bd43-38f95ee9d290 req-0ccbdc9b-9151-404d-be2a-0b398954416a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:08.712693 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-00335689-d351-4b5f-bd43-38f95ee9d290 req-0ccbdc9b-9151-404d-be2a-0b398954416a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 984 time: 0.0685034 Sep 01 17:03:08.727735 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [req-00335689-d351-4b5f-bd43-38f95ee9d290 req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Request body: {'port': {'security_groups': ['66d5c8c4-8327-4b83-9ae2-27a6ee182ca6']}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:08.843199 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-00335689-d351-4b5f-bd43-38f95ee9d290 req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:08.873258 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e952cf3-c29d-4e48-914f-1c6dd2f275c0 req-c45fd417-95fd-432c-95ef-240f6f6bbaf5 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:08.874819 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5e952cf3-c29d-4e48-914f-1c6dd2f275c0 req-c45fd417-95fd-432c-95ef-240f6f6bbaf5 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 944 time: 0.0965478 Sep 01 17:03:08.982116 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5e952cf3-c29d-4e48-914f-1c6dd2f275c0 req-f129da13-35a8-44cb-81a8-ad09cc5c2e3b tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1002867 Sep 01 17:03:09.106369 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c555237d-be17-4662-912a-6adef1cbafc1 req-6b525976-11d3-465d-a264-21f62bfe1f1b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 210 time: 0.0347533 Sep 01 17:03:09.154958 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [req-00335689-d351-4b5f-bd43-38f95ee9d290 req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] For port 6f9364de-2626-4bc4-828f-69a19d15adc9, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=6f9364de-2626-4bc4-828f-69a19d15adc9,segment=NetworkSegment(bd15a57e-34c6-42ac-abbb-bea94ad6f705),segment_id=bd15a57e-34c6-42ac-abbb-bea94ad6f705)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:09.184528 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-00335689-d351-4b5f-bd43-38f95ee9d290 req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for port, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:09.189079 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-00335689-d351-4b5f-bd43-38f95ee9d290 req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6279726'] for port, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:09.201967 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['6f9364de-2626-4bc4-828f-69a19d15adc9'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:03:09.232716 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00335689-d351-4b5f-bd43-38f95ee9d290 req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:09.233446 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [req-00335689-d351-4b5f-bd43-38f95ee9d290 req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:09.234776 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-00335689-d351-4b5f-bd43-38f95ee9d290 req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "PUT /v2.0/ports/6f9364de-2626-4bc4-828f-69a19d15adc9 HTTP/1.1" status: 200 len: 942 time: 0.5138676 Sep 01 17:03:09.235296 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'tag': '6f9364de-2626-4bc4-828f-69a19d15adc9'}] {{(pid=93836) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:09.241376 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}60a7e58791dd3a103db7a0d35103b09d0a4cb2c205e1177c181e158a6fe3866f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-52f4ec95-1973-4199-8f8d-63c755c48af0" -d '{"events": [{"name": "network-changed", "server_uuid": "f84d355d-ae15-4f65-860a-2ccf43911f7e", "tag": "6f9364de-2626-4bc4-828f-69a19d15adc9"}]}' {{(pid=93836) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:09.242475 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 58600) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:09.271211 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event updated for resources: {'Port': ['ID=6f9364de-2626-4bc4-828f-69a19d15adc9,revision_number=7']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:09.283805 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:09.284153 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:09.284792 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:09.285257 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:09.292141 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:09.292506 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:09.292893 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:09.293376 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:09.293628 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:09.294018 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:09.294365 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:09.294704 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-076e0e6a-91a7-424e-9c5b-69833fc0eaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:09.327593 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['6f9364de-2626-4bc4-828f-69a19d15adc9'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:03:09.336613 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8f5e15ee-4a94-40b7-b28b-ea25c2a85f34 x-openstack-request-id: req-8f5e15ee-4a94-40b7-b28b-ea25c2a85f34 {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:09.336613 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f84d355d-ae15-4f65-860a-2ccf43911f7e", "tag": "6f9364de-2626-4bc4-828f-69a19d15adc9", "status": "completed", "code": 200}]} {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:09.336911 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-8f5e15ee-4a94-40b7-b28b-ea25c2a85f34 {{(pid=93836) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:09.337089 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'tag': '6f9364de-2626-4bc4-828f-69a19d15adc9', 'status': 'completed', 'code': 200} Sep 01 17:03:09.432394 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a6234019-fc85-49e2-9bf9-10981b623d66 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:09.443582 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f4ec95-1973-4199-8f8d-63c755c48af0 req-20b7a1cf-88b9-43f1-b764-96cd0b9ae760 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:09.445284 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-52f4ec95-1973-4199-8f8d-63c755c48af0 req-20b7a1cf-88b9-43f1-b764-96cd0b9ae760 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=ccf739a17862469f9bbcedc5abe17cd1&device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 1098 time: 0.0841434 Sep 01 17:03:09.534081 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a6234019-fc85-49e2-9bf9-10981b623d66 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:09.607184 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f4ec95-1973-4199-8f8d-63c755c48af0 req-891b86f4-5e69-4985-8962-c1c0c87d9379 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:09.608680 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-52f4ec95-1973-4199-8f8d-63c755c48af0 req-891b86f4-5e69-4985-8962-c1c0c87d9379 service neutron] 10.222.0.69 "GET /v2.0/networks?id=ab951243-4254-4532-9d93-c294f4a98543 HTTP/1.1" status: 200 len: 915 time: 0.1544492 Sep 01 17:03:09.613771 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-182e67e0-a5ea-4924-af70-8cc49ebd554d None None] Provisioning complete for port 6f9364de-2626-4bc4-828f-69a19d15adc9 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:09.614444 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-182e67e0-a5ea-4924-af70-8cc49ebd554d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:09.679328 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a6234019-fc85-49e2-9bf9-10981b623d66 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:09.682115 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a6234019-fc85-49e2-9bf9-10981b623d66 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:09.683272 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-a6234019-fc85-49e2-9bf9-10981b623d66 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "DELETE /v2.0/security-groups/9dc24496-c4bd-4f26-b512-ce40d586de91 HTTP/1.1" status: 204 len: 168 time: 0.4387717 Sep 01 17:03:09.686156 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58620) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:09.700454 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-52f4ec95-1973-4199-8f8d-63c755c48af0 req-6b73e6ed-7161-4478-996d-49055ed3b80b service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6f9364de-2626-4bc4-828f-69a19d15adc9 HTTP/1.1" status: 200 len: 1001 time: 0.0839324 Sep 01 17:03:09.701306 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6234019-fc85-49e2-9bf9-10981b623d66 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9dc24496-c4bd-4f26-b512-ce40d586de91,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:09.766350 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f4ec95-1973-4199-8f8d-63c755c48af0 req-bca8d16e-907e-4265-a1e7-2e0201d87d55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:09.768624 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-52f4ec95-1973-4199-8f8d-63c755c48af0 req-bca8d16e-907e-4265-a1e7-2e0201d87d55 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=eda7763d-791a-46fa-8a76-190c2898271d HTTP/1.1" status: 200 len: 853 time: 0.0578022 Sep 01 17:03:09.872295 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-bd1f06e3-8f53-471c-bbb5-1d4e19b5aaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Deleting port 765b7908-cf99-4b05-a9c2-94a095a951d2 {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:03:09.872514 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f4ec95-1973-4199-8f8d-63c755c48af0 req-f09a13f3-a28e-4ab5-8483-70eedc5b4f91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:09.872660 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-bd1f06e3-8f53-471c-bbb5-1d4e19b5aaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:09.874005 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-52f4ec95-1973-4199-8f8d-63c755c48af0 req-f09a13f3-a28e-4ab5-8483-70eedc5b4f91 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=ab951243-4254-4532-9d93-c294f4a98543&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0971396 Sep 01 17:03:09.956464 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-bd1f06e3-8f53-471c-bbb5-1d4e19b5aaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:09.956800 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-bd1f06e3-8f53-471c-bbb5-1d4e19b5aaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:09.968683 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-bd1f06e3-8f53-471c-bbb5-1d4e19b5aaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Calling delete_port for 765b7908-cf99-4b05-a9c2-94a095a951d2 owned by network:floatingip {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:03:09.993287 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-91b2b6a2-d21f-4fb7-9c86-de3956a298e3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:09.994790 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-91b2b6a2-d21f-4fb7-9c86-de3956a298e3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.69 "GET /v2.0/networks?id=2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 200 len: 816 time: 0.1784818 Sep 01 17:03:10.014729 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-52f4ec95-1973-4199-8f8d-63c755c48af0 req-e8d329d6-b7b7-4b42-b32c-6af505074f35 service neutron] 10.222.0.69 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1323419 Sep 01 17:03:10.100493 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-fe96e11a-d11c-46a0-83b4-f193683ba97b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=af7d370157f84ca198eb86180115a76f HTTP/1.1" status: 200 len: 380 time: 0.0842364 Sep 01 17:03:10.115883 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-bb411024-1a4b-491a-803f-c26561327c44 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Request body: {'port': {'device_id': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'admin_state_up': True, 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'security_groups': ['5e077c29-f364-4757-85f6-20d583655da1']}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:10.133577 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab98faa9-1e3c-4da5-bfb1-9137003b167a req-5deb5823-ef53-4656-be3a-f58b4e08322b tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:10.135097 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ab98faa9-1e3c-4da5-bfb1-9137003b167a req-5deb5823-ef53-4656-be3a-f58b4e08322b tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 944 time: 0.0728424 Sep 01 17:03:10.148727 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device efd56e04-713d-49e6-9f93-b6c33f23c45b up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:10.226568 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ab98faa9-1e3c-4da5-bfb1-9137003b167a req-fc49c2e8-50d8-4efa-8f21-3281ddd1c12c tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0781684 Sep 01 17:03:10.249212 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3ce4fc3a-d2b2-460a-97e8-711ad8f1ac7f req-2dfdfb8b-0854-417d-b54c-29c1ce7095a7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 210 time: 0.0370800 Sep 01 17:03:10.282949 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-bd1f06e3-8f53-471c-bbb5-1d4e19b5aaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:10.287306 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port efd56e04-713d-49e6-9f93-b6c33f23c45b completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:10.291172 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-bb411024-1a4b-491a-803f-c26561327c44 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Made reservation on behalf of af7d370157f84ca198eb86180115a76f for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:03:10.294540 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port efd56e04-713d-49e6-9f93-b6c33f23c45b triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:10.294996 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:10.295137 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-bb411024-1a4b-491a-803f-c26561327c44 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:10.308089 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-52f4ec95-1973-4199-8f8d-63c755c48af0 req-f5874361-e29d-4c18-8783-9a57d8502a66 service neutron] 10.222.0.69 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2849162 Sep 01 17:03:10.311881 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd1f06e3-8f53-471c-bbb5-1d4e19b5aaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event deleted for resources: {'Port': ['ID=765b7908-cf99-4b05-a9c2-94a095a951d2,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:10.398693 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-bd1f06e3-8f53-471c-bbb5-1d4e19b5aaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks [] for floatingip, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:10.399171 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.l3_db [None req-bd1f06e3-8f53-471c-bbb5-1d4e19b5aaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Floating IP dcc11e71-51e1-4223-82de-de5185af273e disassociated (deleted). External IP: 172.27.1.244, port: 6f9364de-2626-4bc4-828f-69a19d15adc9. Sep 01 17:03:10.430225 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:10.468319 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c57e6fc1-fdb1-405e-9693-6d002580586e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'efd56e04-713d-49e6-9f93-b6c33f23c45b'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:10.471784 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b9c3b889-7768-4438-9458-9ccc6b06aa30" -d '{"events": [{"server_uuid": "c57e6fc1-fdb1-405e-9693-6d002580586e", "name": "network-vif-plugged", "status": "completed", "tag": "efd56e04-713d-49e6-9f93-b6c33f23c45b"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:10.474495 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-bb411024-1a4b-491a-803f-c26561327c44 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Allocated IP 172.20.0.7 (2f7bfe5e-0012-467f-ad7f-aea2467233ac/58fe425a-6b3e-47bd-b5c0-e68ea7782780/c335b865-32be-49e5-9765-66a2bc067d1e) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:03:10.501066 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port efd56e04-713d-49e6-9f93-b6c33f23c45b, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=efd56e04-713d-49e6-9f93-b6c33f23c45b,segment=NetworkSegment(908c9756-53a1-4c99-846c-262c66bbb074),segment_id=908c9756-53a1-4c99-846c-262c66bbb074)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:10.509026 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:10.553292 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f5ee1e49-89cc-46c1-a018-3fbd5f46ab69 x-openstack-request-id: req-f5ee1e49-89cc-46c1-a018-3fbd5f46ab69 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:10.553827 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c57e6fc1-fdb1-405e-9693-6d002580586e", "name": "network-vif-plugged", "status": "completed", "tag": "efd56e04-713d-49e6-9f93-b6c33f23c45b", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:10.554260 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-f5ee1e49-89cc-46c1-a018-3fbd5f46ab69 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:10.554808 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c57e6fc1-fdb1-405e-9693-6d002580586e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'efd56e04-713d-49e6-9f93-b6c33f23c45b', 'code': 200} Sep 01 17:03:10.632967 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=efd56e04-713d-49e6-9f93-b6c33f23c45b,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:10.724187 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd1f06e3-8f53-471c-bbb5-1d4e19b5aaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Router 13010fed-52ce-4d2e-bd27-6579300a2565 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:03:10.803098 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-bb411024-1a4b-491a-803f-c26561327c44 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:10.822946 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-bb411024-1a4b-491a-803f-c26561327c44 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Transition to ACTIVE for port object c335b865-32be-49e5-9765-66a2bc067d1e will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:10.833963 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc97edd1-5fb5-4edd-a2e2-870b227fb32c req-78a7c41c-18cf-4382-9a6a-101cc3c17404 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:10.835780 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-fc97edd1-5fb5-4edd-a2e2-870b227fb32c req-78a7c41c-18cf-4382-9a6a-101cc3c17404 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 1098 time: 0.0969970 Sep 01 17:03:10.851756 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd1f06e3-8f53-471c-bbb5-1d4e19b5aaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:03:10.863019 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-bd1f06e3-8f53-471c-bbb5-1d4e19b5aaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:10.865096 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b13d1e1f-63fa-480c-b23a-14254ab97ad2 None None] Sync routers for ids ['13010fed-52ce-4d2e-bd27-6579300a2565'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:03:10.884566 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b13d1e1f-63fa-480c-b23a-14254ab97ad2 None None] Routers {'13010fed-52ce-4d2e-bd27-6579300a2565'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:10.885202 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-b13d1e1f-63fa-480c-b23a-14254ab97ad2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:02:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['13010fed-52ce-4d2e-bd27-6579300a2565'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:10.899622 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-bd1f06e3-8f53-471c-bbb5-1d4e19b5aaad tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "DELETE /v2.0/floatingips/dcc11e71-51e1-4223-82de-de5185af273e HTTP/1.1" status: 204 len: 168 time: 1.2117338 Sep 01 17:03:10.910234 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-fc97edd1-5fb5-4edd-a2e2-870b227fb32c req-5df1c55b-1e36-402b-aaf4-e4337f36f11c service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650711 Sep 01 17:03:10.922064 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-bb411024-1a4b-491a-803f-c26561327c44 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:11.013620 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-bb411024-1a4b-491a-803f-c26561327c44 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Network 2f7bfe5e-0012-467f-ad7f-aea2467233ac is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:03:11.017744 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-bb411024-1a4b-491a-803f-c26561327c44 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:11.019834 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-bb411024-1a4b-491a-803f-c26561327c44 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:03:11.043086 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-b13d1e1f-63fa-480c-b23a-14254ab97ad2 None None] Set router 13010fed-52ce-4d2e-bd27-6579300a2565 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:11.072487 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb411024-1a4b-491a-803f-c26561327c44 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event updated for resources: {'Port': ['ID=c335b865-32be-49e5-9765-66a2bc067d1e,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:11.095390 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-bb411024-1a4b-491a-803f-c26561327c44 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:11.096264 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-bb411024-1a4b-491a-803f-c26561327c44 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:11.112811 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-bb411024-1a4b-491a-803f-c26561327c44 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0033669 Sep 01 17:03:11.125829 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Request body: {'port': {'device_id': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:11.199054 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:11.338984 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'tag': '6f9364de-2626-4bc4-828f-69a19d15adc9'}] {{(pid=93836) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:11.341331 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}60a7e58791dd3a103db7a0d35103b09d0a4cb2c205e1177c181e158a6fe3866f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cbe2951f-bb87-4f54-baa2-f8ebb2bee03c" -d '{"events": [{"name": "network-changed", "server_uuid": "f84d355d-ae15-4f65-860a-2ccf43911f7e", "tag": "6f9364de-2626-4bc4-828f-69a19d15adc9"}]}' {{(pid=93836) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:11.394678 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-c68a9fa6-ff6c-4fbf-80f5-6df16b7e2801 None None] Provisioning for port c335b865-32be-49e5-9765-66a2bc067d1e completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:11.402665 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-c68a9fa6-ff6c-4fbf-80f5-6df16b7e2801 None None] Provisioning complete for port c335b865-32be-49e5-9765-66a2bc067d1e triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:11.403254 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-c68a9fa6-ff6c-4fbf-80f5-6df16b7e2801 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:11.463394 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d337e740-a775-4b97-bbfc-35c60bcffb30 req-5a3fa676-5459-4351-b5cf-489eb2c6f138 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:11.465105 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d337e740-a775-4b97-bbfc-35c60bcffb30 req-5a3fa676-5459-4351-b5cf-489eb2c6f138 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 931 time: 0.0839272 Sep 01 17:03:11.469836 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-c68a9fa6-ff6c-4fbf-80f5-6df16b7e2801 None None] Port c335b865-32be-49e5-9765-66a2bc067d1e cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:03:11.488603 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f02dacb-c446-4746-9f1e-abf4cf371276 req-680260ef-b1e8-42a2-a3e6-96cae54faf04 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:11.490203 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3f02dacb-c446-4746-9f1e-abf4cf371276 req-680260ef-b1e8-42a2-a3e6-96cae54faf04 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 945 time: 0.0953410 Sep 01 17:03:11.522487 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-b13d1e1f-63fa-480c-b23a-14254ab97ad2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19'}], 'enable_snat': True}, 'gw_port_id': 'a4a1a622-487f-4052-a386-30130de5442b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T16:59:36Z', 'revision_number': 4, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port': {'id': 'a4a1a622-487f-4052-a386-30130de5442b', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:88:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:33Z', 'updated_at': '2021-09-01T16:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '21fd7876-56d5-4a25-811b-f3b09625dc9b', 'name': '', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'mac_address': 'fa:16:3e:43:12:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:35Z', 'updated_at': '2021-09-01T16:59:42Z', 'revision_number': 5, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'subnets': [{'id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:11.535533 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c335b865-32be-49e5-9765-66a2bc067d1e {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:03:11.542395 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d337e740-a775-4b97-bbfc-35c60bcffb30 req-154cfd3a-fe6b-4ee6-a0b3-02b7a64ef9e8 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0681112 Sep 01 17:03:11.547254 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3f02dacb-c446-4746-9f1e-abf4cf371276 req-b7e5c292-5dbb-44b2-91ed-bc5afa34defc tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479507 Sep 01 17:03:11.551073 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b13d1e1f-63fa-480c-b23a-14254ab97ad2 None None] Checking router: 13010fed-52ce-4d2e-bd27-6579300a2565 for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:03:11.552442 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:11.560755 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b13d1e1f-63fa-480c-b23a-14254ab97ad2 None None] Routers {'13010fed-52ce-4d2e-bd27-6579300a2565'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:11.561668 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-b13d1e1f-63fa-480c-b23a-14254ab97ad2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:02:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['13010fed-52ce-4d2e-bd27-6579300a2565'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:11.575038 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Transition to ACTIVE for port object c335b865-32be-49e5-9765-66a2bc067d1e will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:11.579173 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:11.603293 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aa9d551f-b80d-4a9f-a208-d9de00c4f767 x-openstack-request-id: req-aa9d551f-b80d-4a9f-a208-d9de00c4f767 {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:11.603293 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f84d355d-ae15-4f65-860a-2ccf43911f7e", "tag": "6f9364de-2626-4bc4-828f-69a19d15adc9", "status": "completed", "code": 200}]} {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:11.603293 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-aa9d551f-b80d-4a9f-a208-d9de00c4f767 {{(pid=93836) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:11.603586 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'tag': '6f9364de-2626-4bc4-828f-69a19d15adc9', 'status': 'completed', 'code': 200} Sep 01 17:03:11.649702 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Pushing event updated for resources: {'Port': ['ID=c335b865-32be-49e5-9765-66a2bc067d1e,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:11.690594 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-b13d1e1f-63fa-480c-b23a-14254ab97ad2 None None] Set router 13010fed-52ce-4d2e-bd27-6579300a2565 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:11.738656 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe2951f-bb87-4f54-baa2-f8ebb2bee03c req-b1515d95-8df7-4917-a2b8-cdebb68767ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:11.740215 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cbe2951f-bb87-4f54-baa2-f8ebb2bee03c req-b1515d95-8df7-4917-a2b8-cdebb68767ee service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=ccf739a17862469f9bbcedc5abe17cd1&device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 1098 time: 0.1073613 Sep 01 17:03:11.756986 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Attempting to bind port c335b865-32be-49e5-9765-66a2bc067d1e on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:03:11.757361 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Attempting to bind port c335b865-32be-49e5-9765-66a2bc067d1e by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:03:11.757798 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Attempting to bind port c335b865-32be-49e5-9765-66a2bc067d1e on network 2f7bfe5e-0012-467f-ad7f-aea2467233ac {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:03:11.825569 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Port c335b865-32be-49e5-9765-66a2bc067d1e on network 2f7bfe5e-0012-467f-ad7f-aea2467233ac not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:03:11.826301 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Attempting to bind port c335b865-32be-49e5-9765-66a2bc067d1e on network 2f7bfe5e-0012-467f-ad7f-aea2467233ac {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:03:11.838406 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 2, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:03:11.838684 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Checking segment: {'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:03:11.838962 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Bound using segment: {'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:03:11.839401 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Bound port: c335b865-32be-49e5-9765-66a2bc067d1e, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bec5369a-b830-4662-87e0-2fcfaf3604ff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:03:11.839772 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:11.943712 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe2951f-bb87-4f54-baa2-f8ebb2bee03c req-b7fcbf3e-28fd-47bb-bdba-eb2673ecbb61 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:11.945236 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cbe2951f-bb87-4f54-baa2-f8ebb2bee03c req-b7fcbf3e-28fd-47bb-bdba-eb2673ecbb61 service neutron] 10.222.0.69 "GET /v2.0/networks?id=ab951243-4254-4532-9d93-c294f4a98543 HTTP/1.1" status: 200 len: 915 time: 0.1838701 Sep 01 17:03:11.951720 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] For port c335b865-32be-49e5-9765-66a2bc067d1e, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:03:11.955858 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] For port c335b865-32be-49e5-9765-66a2bc067d1e, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=c335b865-32be-49e5-9765-66a2bc067d1e,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:03:11.965642 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:11.966722 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-b13d1e1f-63fa-480c-b23a-14254ab97ad2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19'}], 'enable_snat': True}, 'gw_port_id': 'a4a1a622-487f-4052-a386-30130de5442b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T16:59:36Z', 'revision_number': 4, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port': {'id': 'a4a1a622-487f-4052-a386-30130de5442b', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:88:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:33Z', 'updated_at': '2021-09-01T16:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '21fd7876-56d5-4a25-811b-f3b09625dc9b', 'name': '', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'mac_address': 'fa:16:3e:43:12:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:35Z', 'updated_at': '2021-09-01T16:59:42Z', 'revision_number': 5, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'subnets': [{'id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:12.003809 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b13d1e1f-63fa-480c-b23a-14254ab97ad2 None None] The sync data for ids ['13010fed-52ce-4d2e-bd27-6579300a2565'] in dv-cinder-799668-16-iscsi is: [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19'}], 'enable_snat': True}, 'gw_port_id': 'a4a1a622-487f-4052-a386-30130de5442b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T16:59:36Z', 'revision_number': 4, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port': {'id': 'a4a1a622-487f-4052-a386-30130de5442b', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:88:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:33Z', 'updated_at': '2021-09-01T16:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '21fd7876-56d5-4a25-811b-f3b09625dc9b', 'name': '', 'network_id': 'ab951243-4254-4532-9d93-c294f4a98543', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'mac_address': 'fa:16:3e:43:12:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:35Z', 'updated_at': '2021-09-01T16:59:42Z', 'revision_number': 5, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'subnets': [{'id': 'eda7763d-791a-46fa-8a76-190c2898271d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:03:12.074501 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cbe2951f-bb87-4f54-baa2-f8ebb2bee03c req-3b62d852-0e12-4475-87fb-ec431d515576 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6f9364de-2626-4bc4-828f-69a19d15adc9 HTTP/1.1" status: 200 len: 217 time: 0.1164346 Sep 01 17:03:12.076887 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Pushing event updated for resources: {'Port': ['ID=c335b865-32be-49e5-9765-66a2bc067d1e,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:12.082718 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:12.083274 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:12.084932 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-f44e4cde-5d28-4751-a3dd-38c9acfddf4c service neutron] 10.222.0.69 "PUT /v2.0/ports/c335b865-32be-49e5-9765-66a2bc067d1e HTTP/1.1" status: 200 len: 1093 time: 0.9639843 Sep 01 17:03:12.085488 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'tag': 'c335b865-32be-49e5-9765-66a2bc067d1e'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:12.088820 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e00f4eed-75e9-4479-9485-c941f6ae68b6" -d '{"events": [{"name": "network-changed", "server_uuid": "5e792cf3-d84a-40f8-af00-f4e251c62ed8", "tag": "c335b865-32be-49e5-9765-66a2bc067d1e"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:12.144337 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe2951f-bb87-4f54-baa2-f8ebb2bee03c req-348d6309-a204-44e3-b406-7c502809c893 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:12.145935 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cbe2951f-bb87-4f54-baa2-f8ebb2bee03c req-348d6309-a204-44e3-b406-7c502809c893 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=eda7763d-791a-46fa-8a76-190c2898271d HTTP/1.1" status: 200 len: 853 time: 0.0538163 Sep 01 17:03:12.220038 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dfaef051-38a6-4cfb-884e-2e593255c8bf x-openstack-request-id: req-dfaef051-38a6-4cfb-884e-2e593255c8bf {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:12.221777 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5e792cf3-d84a-40f8-af00-f4e251c62ed8", "tag": "c335b865-32be-49e5-9765-66a2bc067d1e", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:12.222269 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-dfaef051-38a6-4cfb-884e-2e593255c8bf {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:12.224065 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'tag': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'status': 'completed', 'code': 200} Sep 01 17:03:12.326402 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe2951f-bb87-4f54-baa2-f8ebb2bee03c req-e0f226dc-82ca-4d5e-b098-6c5046d6f8b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:12.328141 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cbe2951f-bb87-4f54-baa2-f8ebb2bee03c req-e0f226dc-82ca-4d5e-b098-6c5046d6f8b1 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=ab951243-4254-4532-9d93-c294f4a98543&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1734924 Sep 01 17:03:12.431633 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d932e703-86bd-458b-8336-a86c189c4e9b None None] New status for floating IP dcc11e71-51e1-4223-82de-de5185af273e: DOWN {{(pid=93838) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:03:12.436988 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-9c93f3b6-2b8c-4b4f-8725-5d04c2b2396b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:12.438813 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-9c93f3b6-2b8c-4b4f-8725-5d04c2b2396b service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 1096 time: 0.2038865 Sep 01 17:03:12.528148 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-4b9e7a8f-f57f-46e7-93af-19f63fd584e2 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c335b865-32be-49e5-9765-66a2bc067d1e HTTP/1.1" status: 200 len: 217 time: 0.0740623 Sep 01 17:03:12.605024 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cbe2951f-bb87-4f54-baa2-f8ebb2bee03c req-65f8fd05-3df4-4597-9605-01c34ec27b9d service neutron] 10.222.0.69 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2603688 Sep 01 17:03:12.613410 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-07280b86-f711-429e-8d07-b5065f4f66e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:12.615491 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-07280b86-f711-429e-8d07-b5065f4f66e8 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=58fe425a-6b3e-47bd-b5c0-e68ea7782780 HTTP/1.1" status: 200 len: 855 time: 0.0727587 Sep 01 17:03:12.755557 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-a860a5a5-823c-4d43-a03b-b7a4394d8900 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:12.757969 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-a860a5a5-823c-4d43-a03b-b7a4394d8900 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2f7bfe5e-0012-467f-ad7f-aea2467233ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1323705 Sep 01 17:03:12.768646 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfcbf9d4-2f18-4c10-9ae0-eab79d4f4c72 req-19773f2b-ef92-42dc-8122-4cd1de886ebb tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:12.778528 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-dfcbf9d4-2f18-4c10-9ae0-eab79d4f4c72 req-19773f2b-ef92-42dc-8122-4cd1de886ebb tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 945 time: 0.1098552 Sep 01 17:03:12.828759 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-dfcbf9d4-2f18-4c10-9ae0-eab79d4f4c72 req-692d1d08-2183-4e0c-ad2b-2eebba98f291 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471811 Sep 01 17:03:12.838421 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0adc6a03-c30c-4c88-aa60-8566a468c075 req-6a45f074-2682-4ccc-bb1d-819cc479533a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:12.840065 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0adc6a03-c30c-4c88-aa60-8566a468c075 req-6a45f074-2682-4ccc-bb1d-819cc479533a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.1394773 Sep 01 17:03:12.910652 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0adc6a03-c30c-4c88-aa60-8566a468c075 req-6a081bf6-53f7-4b7a-b45e-b2b9a8722041 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0604494 Sep 01 17:03:13.167793 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cbe2951f-bb87-4f54-baa2-f8ebb2bee03c req-2ffd8caa-4d89-43fc-88e8-0999c25ea6ba service neutron] 10.222.0.69 "GET /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5518672 Sep 01 17:03:13.204174 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-cb453a5d-d8a0-4d57-a584-768ad4b0fe2c service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4371822 Sep 01 17:03:13.269568 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58762) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:13.332964 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cc9bf361-8610-4013-8587-b5ae196b9fe5 req-efd6bce7-f0b6-47be-9040-96199f80524c service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1215396 Sep 01 17:03:13.415858 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9519eac4-b827-45ea-a20b-ebfc07e0b54c admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:13.445493 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00f4eed-75e9-4479-9485-c941f6ae68b6 req-5e86baca-d968-4401-96a5-0bea52bded76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:13.447081 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e00f4eed-75e9-4479-9485-c941f6ae68b6 req-5e86baca-d968-4401-96a5-0bea52bded76 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 1096 time: 0.0478446 Sep 01 17:03:13.534623 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9519eac4-b827-45ea-a20b-ebfc07e0b54c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:13.540320 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9519eac4-b827-45ea-a20b-ebfc07e0b54c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:13.573680 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00f4eed-75e9-4479-9485-c941f6ae68b6 req-5ee9fbac-02c4-4028-9842-6f5bc36376fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:13.575342 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e00f4eed-75e9-4479-9485-c941f6ae68b6 req-5ee9fbac-02c4-4028-9842-6f5bc36376fe service neutron] 10.222.0.69 "GET /v2.0/networks?id=2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 200 len: 917 time: 0.1164157 Sep 01 17:03:13.582132 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-9519eac4-b827-45ea-a20b-ebfc07e0b54c admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=e573d5f6342c4b5b81d0385daa2b55a1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3105562 Sep 01 17:03:13.583165 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9519eac4-b827-45ea-a20b-ebfc07e0b54c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb93414e-27ed-4844-b9f7-cde71111b711,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:13.585113 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 58772) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:13.629880 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e00f4eed-75e9-4479-9485-c941f6ae68b6 req-ae665a40-2b4e-4ead-a8d6-a5822bb9c067 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c335b865-32be-49e5-9765-66a2bc067d1e HTTP/1.1" status: 200 len: 217 time: 0.0457489 Sep 01 17:03:13.712030 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00f4eed-75e9-4479-9485-c941f6ae68b6 req-13f0726f-22d5-47f4-8420-8d54dba42ea5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:13.713590 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e00f4eed-75e9-4479-9485-c941f6ae68b6 req-13f0726f-22d5-47f4-8420-8d54dba42ea5 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=58fe425a-6b3e-47bd-b5c0-e68ea7782780 HTTP/1.1" status: 200 len: 855 time: 0.0760968 Sep 01 17:03:13.718278 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1f2ebf8a-4d6f-4a64-b1ba-ab45966a6e12 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:13.773193 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1f2ebf8a-4d6f-4a64-b1ba-ab45966a6e12 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:13.809008 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00f4eed-75e9-4479-9485-c941f6ae68b6 req-63ee09f7-5cc8-435d-b00c-abb1d3867fbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:13.810782 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e00f4eed-75e9-4479-9485-c941f6ae68b6 req-63ee09f7-5cc8-435d-b00c-abb1d3867fbf service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2f7bfe5e-0012-467f-ad7f-aea2467233ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0892873 Sep 01 17:03:13.903073 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1f2ebf8a-4d6f-4a64-b1ba-ab45966a6e12 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:13.905911 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1f2ebf8a-4d6f-4a64-b1ba-ab45966a6e12 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:13.909728 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-1f2ebf8a-4d6f-4a64-b1ba-ab45966a6e12 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/cb93414e-27ed-4844-b9f7-cde71111b711 HTTP/1.1" status: 204 len: 168 time: 0.3137419 Sep 01 17:03:13.918948 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f2ebf8a-4d6f-4a64-b1ba-ab45966a6e12 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb93414e-27ed-4844-b9f7-cde71111b711,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:13.935550 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e00f4eed-75e9-4479-9485-c941f6ae68b6 req-6afac028-42ce-4faa-a722-d4d26a0d0fcb service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1073914 Sep 01 17:03:14.121898 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e00f4eed-75e9-4479-9485-c941f6ae68b6 req-b5efa697-7acf-4570-9912-f1c6633b86e2 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1708384 Sep 01 17:03:14.122534 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-362b0a25-af92-46c8-b54b-ff69897749d4 req-6d9fcd82-1c80-46ba-b7e9-fd151ba8d603 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:14.124223 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-362b0a25-af92-46c8-b54b-ff69897749d4 req-6d9fcd82-1c80-46ba-b7e9-fd151ba8d603 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.1129501 Sep 01 17:03:14.138275 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ec74864-3c81-4f55-9346-132a6ad2c3fc req-da00b001-18c8-4713-aa44-227f26fa1140 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:14.140232 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8ec74864-3c81-4f55-9346-132a6ad2c3fc req-da00b001-18c8-4713-aa44-227f26fa1140 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 945 time: 0.0801110 Sep 01 17:03:14.208318 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8ec74864-3c81-4f55-9346-132a6ad2c3fc req-39acffd6-47c6-4a2d-9ab0-ea3dc549ffdf tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0607145 Sep 01 17:03:14.220025 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-362b0a25-af92-46c8-b54b-ff69897749d4 req-ffb416a1-851e-4d2d-981a-58387122fefc tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0761940 Sep 01 17:03:14.283694 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 58794) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:14.297808 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c550ac54-9a78-4776-852a-5c7af70414f9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:14.395478 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c550ac54-9a78-4776-852a-5c7af70414f9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:14.399201 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-c550ac54-9a78-4776-852a-5c7af70414f9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:14.436826 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c550ac54-9a78-4776-852a-5c7af70414f9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6876bc73-f434-449f-8d72-160959438438,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:14.442114 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-c550ac54-9a78-4776-852a-5c7af70414f9 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=e4285ecbe5cb44e58c63395e9f1738b3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1573503 Sep 01 17:03:14.444868 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58802) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:14.504472 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c4604fe7-4f2b-4f56-b64c-23bf85f4b1d6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:14.525233 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c4604fe7-4f2b-4f56-b64c-23bf85f4b1d6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:14.571733 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c4604fe7-4f2b-4f56-b64c-23bf85f4b1d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:14.574331 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c4604fe7-4f2b-4f56-b64c-23bf85f4b1d6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:14.575472 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c4604fe7-4f2b-4f56-b64c-23bf85f4b1d6 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/6876bc73-f434-449f-8d72-160959438438 HTTP/1.1" status: 204 len: 168 time: 0.1296043 Sep 01 17:03:14.583032 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4604fe7-4f2b-4f56-b64c-23bf85f4b1d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6876bc73-f434-449f-8d72-160959438438,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:15.371085 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13798c84-5698-45d5-a7eb-b83de248d931 req-0a642314-e234-42fd-9826-4301f21720fe tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:15.372664 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-13798c84-5698-45d5-a7eb-b83de248d931 req-0a642314-e234-42fd-9826-4301f21720fe tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 945 time: 0.0860612 Sep 01 17:03:15.381367 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce66b2e7-c16b-41bb-ad60-7a200b22f9fe req-9b0dbe2c-3550-4517-8760-174dae9f5774 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:15.382868 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ce66b2e7-c16b-41bb-ad60-7a200b22f9fe req-9b0dbe2c-3550-4517-8760-174dae9f5774 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0942204 Sep 01 17:03:15.445578 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-13798c84-5698-45d5-a7eb-b83de248d931 req-33bb953c-b117-4f5d-8a94-ab35878f6bbd tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/security-groups?id=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0616927 Sep 01 17:03:15.448378 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ce66b2e7-c16b-41bb-ad60-7a200b22f9fe req-5ad2f39f-0149-4d3d-84b1-ab9555fb4071 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0585189 Sep 01 17:03:15.919804 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a5ac0c0-c655-4fa4-aeea-38d1296787d3 req-cc266f66-6161-40c5-9461-3f331974e764 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:15.921325 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2a5ac0c0-c655-4fa4-aeea-38d1296787d3 req-cc266f66-6161-40c5-9461-3f331974e764 tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.69 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 945 time: 0.0571606 Sep 01 17:03:16.024686 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-2a5ac0c0-c655-4fa4-aeea-38d1296787d3 req-8cd26054-2669-4dc1-aecb-39f417d1108a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Deleting port 6f9364de-2626-4bc4-828f-69a19d15adc9 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:03:16.025041 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-2a5ac0c0-c655-4fa4-aeea-38d1296787d3 req-8cd26054-2669-4dc1-aecb-39f417d1108a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:16.128066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-2a5ac0c0-c655-4fa4-aeea-38d1296787d3 req-8cd26054-2669-4dc1-aecb-39f417d1108a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] For port 6f9364de-2626-4bc4-828f-69a19d15adc9, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=6f9364de-2626-4bc4-828f-69a19d15adc9,segment=NetworkSegment(bd15a57e-34c6-42ac-abbb-bea94ad6f705),segment_id=bd15a57e-34c6-42ac-abbb-bea94ad6f705)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:16.128504 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-2a5ac0c0-c655-4fa4-aeea-38d1296787d3 req-8cd26054-2669-4dc1-aecb-39f417d1108a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:16.141670 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-2a5ac0c0-c655-4fa4-aeea-38d1296787d3 req-8cd26054-2669-4dc1-aecb-39f417d1108a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Calling delete_port for 6f9364de-2626-4bc4-828f-69a19d15adc9 owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:03:16.160840 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device c335b865-32be-49e5-9765-66a2bc067d1e details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:03:16.267023 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port c335b865-32be-49e5-9765-66a2bc067d1e, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=c335b865-32be-49e5-9765-66a2bc067d1e,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:16.283099 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'port_id': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'mac_address': 'fa:16:3e:96:5a:bf', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 544, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:03:16.292330 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-2a5ac0c0-c655-4fa4-aeea-38d1296787d3 req-8cd26054-2669-4dc1-aecb-39f417d1108a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:16.325254 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['6f9364de-2626-4bc4-828f-69a19d15adc9'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:03:16.338364 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cd26054-2669-4dc1-aecb-39f417d1108a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Pushing event deleted for resources: {'Port': ['ID=6f9364de-2626-4bc4-828f-69a19d15adc9,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:16.378743 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:16.391080 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a5ac0c0-c655-4fa4-aeea-38d1296787d3 req-8cd26054-2669-4dc1-aecb-39f417d1108a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] No DVR routers for this DVR port 6f9364de-2626-4bc4-828f-69a19d15adc9 on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:03:16.396639 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-2a5ac0c0-c655-4fa4-aeea-38d1296787d3 req-8cd26054-2669-4dc1-aecb-39f417d1108a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:16.400558 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2a5ac0c0-c655-4fa4-aeea-38d1296787d3 req-8cd26054-2669-4dc1-aecb-39f417d1108a tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.69 "DELETE /v2.0/ports/6f9364de-2626-4bc4-828f-69a19d15adc9 HTTP/1.1" status: 204 len: 173 time: 0.4727447 Sep 01 17:03:16.403480 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'name': 'network-vif-deleted', 'tag': '6f9364de-2626-4bc4-828f-69a19d15adc9'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:16.407770 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-32e96807-7228-4e0b-bc4f-0b99aef08327" -d '{"events": [{"server_uuid": "f84d355d-ae15-4f65-860a-2ccf43911f7e", "name": "network-vif-deleted", "tag": "6f9364de-2626-4bc4-828f-69a19d15adc9"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:16.412301 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c335b865-32be-49e5-9765-66a2bc067d1e {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:03:16.436212 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port c335b865-32be-49e5-9765-66a2bc067d1e, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=c335b865-32be-49e5-9765-66a2bc067d1e,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:16.442509 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:16.484318 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e088126-1e45-4d14-8b1b-9115e87c2f72 x-openstack-request-id: req-4e088126-1e45-4d14-8b1b-9115e87c2f72 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:16.484615 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f84d355d-ae15-4f65-860a-2ccf43911f7e", "name": "network-vif-deleted", "tag": "6f9364de-2626-4bc4-828f-69a19d15adc9", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:16.484947 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-4e088126-1e45-4d14-8b1b-9115e87c2f72 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:16.485428 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f84d355d-ae15-4f65-860a-2ccf43911f7e', 'name': 'network-vif-deleted', 'tag': '6f9364de-2626-4bc4-828f-69a19d15adc9', 'status': 'completed', 'code': 200} Sep 01 17:03:16.514001 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=c335b865-32be-49e5-9765-66a2bc067d1e,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:16.602327 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2f677fab-5201-47f8-ac7e-703ce6ff0555 req-6ef24310-4006-47cb-a7a5-b9ca39ae191f tempest-TestMinimumBasicScenario-1360493937 tempest-TestMinimumBasicScenario-1360493937-project] 10.222.0.67 "GET /v2.0/ports?device_id=f84d355d-ae15-4f65-860a-2ccf43911f7e HTTP/1.1" status: 200 len: 210 time: 0.0407717 Sep 01 17:03:16.622048 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d36c0b4-2ac1-41f5-acfb-58c268a1877c req-610c1008-102e-4ed6-95ed-384394de3aef tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:16.623505 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4d36c0b4-2ac1-41f5-acfb-58c268a1877c req-610c1008-102e-4ed6-95ed-384394de3aef tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 944 time: 0.0741313 Sep 01 17:03:16.663425 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4d36c0b4-2ac1-41f5-acfb-58c268a1877c req-c132bb09-b87e-440f-accf-bb24bc383956 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0327110 Sep 01 17:03:16.696420 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['c335b865-32be-49e5-9765-66a2bc067d1e'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:03:17.790765 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aad89e9b-f2e4-4c38-9a6c-f517d5a506af req-86462e2c-a5b8-4740-bcd0-607b24f006ac tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:17.792266 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-aad89e9b-f2e4-4c38-9a6c-f517d5a506af req-86462e2c-a5b8-4740-bcd0-607b24f006ac tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 944 time: 0.0493581 Sep 01 17:03:17.848615 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-aad89e9b-f2e4-4c38-9a6c-f517d5a506af req-e006e726-1a7e-4a34-9cd1-be956bce7ac8 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496807 Sep 01 17:03:18.171868 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device c335b865-32be-49e5-9765-66a2bc067d1e up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:18.221476 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port c335b865-32be-49e5-9765-66a2bc067d1e completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:18.224927 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port c335b865-32be-49e5-9765-66a2bc067d1e triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:18.225303 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:18.309418 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:18.334544 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c335b865-32be-49e5-9765-66a2bc067d1e'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:18.337106 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8fc14007-730a-4d86-bc69-6ded0ca9f4d7" -d '{"events": [{"server_uuid": "5e792cf3-d84a-40f8-af00-f4e251c62ed8", "name": "network-vif-plugged", "status": "completed", "tag": "c335b865-32be-49e5-9765-66a2bc067d1e"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:18.340098 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58956) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:18.359113 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port c335b865-32be-49e5-9765-66a2bc067d1e, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=c335b865-32be-49e5-9765-66a2bc067d1e,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:18.367020 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:18.367020 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 6f9364de-2626-4bc4-828f-69a19d15adc9 no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:03:18.409594 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1111a118-1c31-4cd1-aed8-877a8621c2e9 x-openstack-request-id: req-1111a118-1c31-4cd1-aed8-877a8621c2e9 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:18.409886 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5e792cf3-d84a-40f8-af00-f4e251c62ed8", "name": "network-vif-plugged", "status": "completed", "tag": "c335b865-32be-49e5-9765-66a2bc067d1e", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:18.410161 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-1111a118-1c31-4cd1-aed8-877a8621c2e9 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:18.410550 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'code': 200} Sep 01 17:03:18.413807 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: 6f9364de-2626-4bc4-828f-69a19d15adc9 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:03:18.414156 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 6f9364de-2626-4bc4-828f-69a19d15adc9 not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:03:18.442296 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=c335b865-32be-49e5-9765-66a2bc067d1e,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:18.562642 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58962) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:18.578969 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3324ed2-5834-491e-bd0f-41c2f019e9ef req-afb7407a-b476-459c-9d8b-a6bd72b2a6e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:18.580739 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a3324ed2-5834-491e-bd0f-41c2f019e9ef req-afb7407a-b476-459c-9d8b-a6bd72b2a6e7 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 1098 time: 0.0450680 Sep 01 17:03:18.621132 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a3324ed2-5834-491e-bd0f-41c2f019e9ef req-4892e36c-d90c-40b8-84ed-aaba4cc72bb5 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320985 Sep 01 17:03:18.690140 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3b8fe72e-409a-4af9-a60f-0710cebc14b0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:18.878782 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3b8fe72e-409a-4af9-a60f-0710cebc14b0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:18.889213 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3b8fe72e-409a-4af9-a60f-0710cebc14b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:18.904845 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-60649f28-7cc6-4d52-b9b2-54e61b98a238 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1832465'] for router_interface, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:19.001645 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-3b8fe72e-409a-4af9-a60f-0710cebc14b0 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=dc94cc9919a44a16a46a605607518c2b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4375901 Sep 01 17:03:19.004208 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58976) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:19.007864 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b8fe72e-409a-4af9-a60f-0710cebc14b0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c7b48cf1-4923-4deb-9e59-54b229d99250,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:19.098114 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dea80cc5-adfa-49be-b966-d1cab4e41fa1 req-e6e94ddc-c127-4e12-a457-f7a4a7906962 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:19.099615 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-dea80cc5-adfa-49be-b966-d1cab4e41fa1 req-e6e94ddc-c127-4e12-a457-f7a4a7906962 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.1551347 Sep 01 17:03:19.441968 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f149f31d-b392-4dc8-8821-53cf84cb8b5f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:19.478059 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-dea80cc5-adfa-49be-b966-d1cab4e41fa1 req-abd2fc50-8104-473c-be11-f1d2a30070a6 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1027269 Sep 01 17:03:19.491459 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f149f31d-b392-4dc8-8821-53cf84cb8b5f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:19.592539 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f149f31d-b392-4dc8-8821-53cf84cb8b5f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:19.595049 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f149f31d-b392-4dc8-8821-53cf84cb8b5f admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:19.597272 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-f149f31d-b392-4dc8-8821-53cf84cb8b5f admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/c7b48cf1-4923-4deb-9e59-54b229d99250 HTTP/1.1" status: 204 len: 168 time: 0.5905056 Sep 01 17:03:19.607399 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f149f31d-b392-4dc8-8821-53cf84cb8b5f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c7b48cf1-4923-4deb-9e59-54b229d99250,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:19.634469 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-60649f28-7cc6-4d52-b9b2-54e61b98a238 admin admin] Deleting port 21fd7876-56d5-4a25-811b-f3b09625dc9b {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:03:19.634982 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-60649f28-7cc6-4d52-b9b2-54e61b98a238 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:19.730386 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [None req-60649f28-7cc6-4d52-b9b2-54e61b98a238 admin admin] For port 21fd7876-56d5-4a25-811b-f3b09625dc9b, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=21fd7876-56d5-4a25-811b-f3b09625dc9b,segment=NetworkSegment(bd15a57e-34c6-42ac-abbb-bea94ad6f705),segment_id=bd15a57e-34c6-42ac-abbb-bea94ad6f705)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:19.730765 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-60649f28-7cc6-4d52-b9b2-54e61b98a238 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:19.754538 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-60649f28-7cc6-4d52-b9b2-54e61b98a238 admin admin] Calling delete_port for 21fd7876-56d5-4a25-811b-f3b09625dc9b owned by network:router_interface {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:03:19.952721 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-60649f28-7cc6-4d52-b9b2-54e61b98a238 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:19.979249 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60649f28-7cc6-4d52-b9b2-54e61b98a238 admin admin] Pushing event deleted for resources: {'Port': ['ID=21fd7876-56d5-4a25-811b-f3b09625dc9b,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:20.156146 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-60649f28-7cc6-4d52-b9b2-54e61b98a238 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611377', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1832589'] for router_interface, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:20.371349 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-60649f28-7cc6-4d52-b9b2-54e61b98a238 admin admin] Router 13010fed-52ce-4d2e-bd27-6579300a2565 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:03:20.482557 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-60649f28-7cc6-4d52-b9b2-54e61b98a238 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:03:20.488292 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-60649f28-7cc6-4d52-b9b2-54e61b98a238 admin admin] 10.222.0.67 "PUT /v2.0/routers/13010fed-52ce-4d2e-bd27-6579300a2565/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1441948 Sep 01 17:03:20.490639 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 58998) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:20.492701 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3cbcf28-6229-4353-bd63-84476e978ead None None] Sync routers for ids ['13010fed-52ce-4d2e-bd27-6579300a2565'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:03:20.502186 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3cbcf28-6229-4353-bd63-84476e978ead None None] Routers {'13010fed-52ce-4d2e-bd27-6579300a2565'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:20.502898 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-d3cbcf28-6229-4353-bd63-84476e978ead None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:02:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['13010fed-52ce-4d2e-bd27-6579300a2565'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:20.609716 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59004) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:20.618383 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-d3cbcf28-6229-4353-bd63-84476e978ead None None] Set router 13010fed-52ce-4d2e-bd27-6579300a2565 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:20.632426 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] Notify callbacks [] for router, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:20.678717 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d33dc1a4-9288-45e8-908d-d11cc0a9306e req-1293c55b-ada7-4afd-a179-67811d7ea453 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:20.680330 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d33dc1a4-9288-45e8-908d-d11cc0a9306e req-1293c55b-ada7-4afd-a179-67811d7ea453 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.1018713 Sep 01 17:03:20.727352 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-62704feb-c919-4c3b-8163-38c4e1b54fde admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:20.782166 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d33dc1a4-9288-45e8-908d-d11cc0a9306e req-f9063329-4144-4666-a0d2-c8c2283c2dbb tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0761285 Sep 01 17:03:20.794739 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:20.835684 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-d3cbcf28-6229-4353-bd63-84476e978ead None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19'}], 'enable_snat': True}, 'gw_port_id': 'a4a1a622-487f-4052-a386-30130de5442b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T17:03:19Z', 'revision_number': 5, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port': {'id': 'a4a1a622-487f-4052-a386-30130de5442b', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:88:54', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:33Z', 'updated_at': '2021-09-01T16:59:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:20.865439 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-62704feb-c919-4c3b-8163-38c4e1b54fde admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:20.870795 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-62704feb-c919-4c3b-8163-38c4e1b54fde admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:20.880032 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] Deleting port a4a1a622-487f-4052-a386-30130de5442b {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:03:20.880244 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3cbcf28-6229-4353-bd63-84476e978ead None None] Checking router: 13010fed-52ce-4d2e-bd27-6579300a2565 for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:03:20.880381 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:20.889122 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3cbcf28-6229-4353-bd63-84476e978ead None None] Routers {'13010fed-52ce-4d2e-bd27-6579300a2565'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:20.889793 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-d3cbcf28-6229-4353-bd63-84476e978ead None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:02:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['13010fed-52ce-4d2e-bd27-6579300a2565'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:20.910126 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62704feb-c919-4c3b-8163-38c4e1b54fde admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dae08c27-8524-49d9-b51b-838ffa5608c5,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:20.938969 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-62704feb-c919-4c3b-8163-38c4e1b54fde admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=61293dbb1c8c4fb49bd378ed4b6c8152&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3280673 Sep 01 17:03:20.939731 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59016) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:20.986861 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] For port a4a1a622-487f-4052-a386-30130de5442b, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=a4a1a622-487f-4052-a386-30130de5442b,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:20.987589 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:20.998128 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8ad94727-db05-484d-8425-7e0d71f9bf18 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.001745 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] Calling delete_port for a4a1a622-487f-4052-a386-30130de5442b owned by network:router_gateway {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:03:21.004962 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-d3cbcf28-6229-4353-bd63-84476e978ead None None] Set router 13010fed-52ce-4d2e-bd27-6579300a2565 gateway port host: None {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:21.024463 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8ad94727-db05-484d-8425-7e0d71f9bf18 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.064019 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-d3cbcf28-6229-4353-bd63-84476e978ead None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T17:03:20Z', 'revision_number': 6, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port_host': None}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:21.092166 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3cbcf28-6229-4353-bd63-84476e978ead None None] The sync data for ids ['13010fed-52ce-4d2e-bd27-6579300a2565'] in dv-cinder-799668-16-iscsi is: [{'id': '13010fed-52ce-4d2e-bd27-6579300a2565', 'name': 'tempest-TestMinimumBasicScenario-788092363-router', 'tenant_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:32Z', 'updated_at': '2021-09-01T17:03:20Z', 'revision_number': 6, 'project_id': 'ccf739a17862469f9bbcedc5abe17cd1', 'gw_port_host': None}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:03:21.093681 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8ad94727-db05-484d-8425-7e0d71f9bf18 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.097185 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8ad94727-db05-484d-8425-7e0d71f9bf18 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.101243 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-8ad94727-db05-484d-8425-7e0d71f9bf18 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/dae08c27-8524-49d9-b51b-838ffa5608c5 HTTP/1.1" status: 204 len: 168 time: 0.1576343 Sep 01 17:03:21.109604 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ad94727-db05-484d-8425-7e0d71f9bf18 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dae08c27-8524-49d9-b51b-838ffa5608c5,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:21.203260 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.243207 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-edd5d41b-6ca4-43af-826e-cf7b5f358022 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.261820 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] Pushing event deleted for resources: {'Port': ['ID=a4a1a622-487f-4052-a386-30130de5442b,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:21.325123 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e6fcd3e-fd4a-422c-8d7a-500b2e4f2bca req-f3e007a3-4b59-4746-87e8-70152eb3a0c4 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:21.326660 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8e6fcd3e-fd4a-422c-8d7a-500b2e4f2bca req-f3e007a3-4b59-4746-87e8-70152eb3a0c4 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.4578283 Sep 01 17:03:21.335993 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59024) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:21.340385 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1827887'] for router_gateway, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.341253 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-10e9244d-c4c6-4e0e-9937-bff6dc6af923 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Request body: {'floatingip': {'port_id': 'c335b865-32be-49e5-9765-66a2bc067d1e'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:21.387124 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-10e9244d-c4c6-4e0e-9937-bff6dc6af923 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for floatingip, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.416051 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59026) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:21.456571 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5fbc595f-969c-48be-a310-287fbe828a00 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.459546 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1821713', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4617'] for router, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.462521 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.550424 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1821722'] for router, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.550960 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 13010fed-52ce-4d2e-bd27-6579300a2565 {{(pid=93836) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 01 17:03:21.555959 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] Notify callbacks [] for router, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.559399 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-4bf1bdf7-d38c-4c63-8168-e9ffdce83162 admin admin] 10.222.0.67 "DELETE /v2.0/routers/13010fed-52ce-4d2e-bd27-6579300a2565 HTTP/1.1" status: 204 len: 168 time: 1.0654631 Sep 01 17:03:21.559935 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59028) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:21.622765 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_v2 [None req-5979840e-9c2a-429e-8e0d-ab2df5e338c4 admin admin] Deleting subnet eda7763d-791a-46fa-8a76-190c2898271d {{(pid=93836) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 17:03:21.629907 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5979840e-9c2a-429e-8e0d-ab2df5e338c4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.676329 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5979840e-9c2a-429e-8e0d-ab2df5e338c4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5815122'] for subnet, precommit_delete_associations {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.724669 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5fbc595f-969c-48be-a310-287fbe828a00 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.730765 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5fbc595f-969c-48be-a310-287fbe828a00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.818553 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-5fbc595f-969c-48be-a310-287fbe828a00 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=b4cad273a4c0426daa92d602ca2a6002&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4013543 Sep 01 17:03:21.823861 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59030) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:21.824492 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fbc595f-969c-48be-a310-287fbe828a00 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1452e0e4-9526-4dca-b6e1-06d5dab3402e,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:21.861642 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5979840e-9c2a-429e-8e0d-ab2df5e338c4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.865834 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-10e9244d-c4c6-4e0e-9937-bff6dc6af923 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for floatingip, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.870623 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-10e9244d-c4c6-4e0e-9937-bff6dc6af923 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.928740 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6b82b25d-f5c9-48df-b292-63e3b18684cd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.952005 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5979840e-9c2a-429e-8e0d-ab2df5e338c4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6279800', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6181087'] for subnet, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.959379 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6b82b25d-f5c9-48df-b292-63e3b18684cd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:21.981375 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.l3_db [None req-10e9244d-c4c6-4e0e-9937-bff6dc6af923 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Floating IP 3348b2d7-616e-4187-b53c-37f9077d14e3 associated. External IP: 172.27.1.183, port: c335b865-32be-49e5-9765-66a2bc067d1e. Sep 01 17:03:21.996773 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5979840e-9c2a-429e-8e0d-ab2df5e338c4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=eda7763d-791a-46fa-8a76-190c2898271d,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:22.012332 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2114c0f4-2d41-4e41-9edb-8eb00a04e9c4 None None] Network ab951243-4254-4532-9d93-c294f4a98543 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:03:22.022296 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5979840e-9c2a-429e-8e0d-ab2df5e338c4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.024423 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-5979840e-9c2a-429e-8e0d-ab2df5e338c4 admin admin] 10.222.0.67 "DELETE /v2.0/subnets/eda7763d-791a-46fa-8a76-190c2898271d HTTP/1.1" status: 204 len: 168 time: 0.4638412 Sep 01 17:03:22.027255 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59034) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:22.104504 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6b82b25d-f5c9-48df-b292-63e3b18684cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.107086 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6b82b25d-f5c9-48df-b292-63e3b18684cd admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.117765 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-6b82b25d-f5c9-48df-b292-63e3b18684cd admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/1452e0e4-9526-4dca-b6e1-06d5dab3402e HTTP/1.1" status: 204 len: 168 time: 0.2837741 Sep 01 17:03:22.137177 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.146339 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b82b25d-f5c9-48df-b292-63e3b18684cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1452e0e4-9526-4dca-b6e1-06d5dab3402e,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:22.241511 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Deleting port 16f42807-e8cd-47da-bb02-a97a89b74a3a {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:03:22.241915 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.270514 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-10e9244d-c4c6-4e0e-9937-bff6dc6af923 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:03:22.276609 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea6dc582-7227-4fc5-ac5d-d64372dba16b None None] DHCP port deletion for ab951243-4254-4532-9d93-c294f4a98543 request from dv-cinder-799668-16-iscsi {{(pid=93837) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 01 17:03:22.330550 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] For port 16f42807-e8cd-47da-bb02-a97a89b74a3a, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=16f42807-e8cd-47da-bb02-a97a89b74a3a,segment=NetworkSegment(bd15a57e-34c6-42ac-abbb-bea94ad6f705),segment_id=bd15a57e-34c6-42ac-abbb-bea94ad6f705)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:22.331001 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.346965 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Calling delete_port for 16f42807-e8cd-47da-bb02-a97a89b74a3a owned by network:dhcp {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:03:22.350661 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-ea6dc582-7227-4fc5-ac5d-d64372dba16b None None] Deleting port 16f42807-e8cd-47da-bb02-a97a89b74a3a {{(pid=93837) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:03:22.351273 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-ea6dc582-7227-4fc5-ac5d-d64372dba16b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.449705 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-10e9244d-c4c6-4e0e-9937-bff6dc6af923 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:03:22.454103 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.457646 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-10e9244d-c4c6-4e0e-9937-bff6dc6af923 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.467553 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1a254c8-6549-40f6-a651-834e7b5abc5d None None] Sync routers for ids ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:03:22.480534 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1a254c8-6549-40f6-a651-834e7b5abc5d None None] Routers {'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:22.481166 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-e1a254c8-6549-40f6-a651-834e7b5abc5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:02:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:22.499936 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Pushing event deleted for resources: {'Port': ['ID=16f42807-e8cd-47da-bb02-a97a89b74a3a,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:22.504900 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] No DVR routers for this DVR port 16f42807-e8cd-47da-bb02-a97a89b74a3a on host dv-cinder-799668-16-iscsi {{(pid=93836) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:03:22.508632 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-10e9244d-c4c6-4e0e-9937-bff6dc6af923 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "PUT /v2.0/floatingips/3348b2d7-616e-4187-b53c-37f9077d14e3 HTTP/1.1" status: 200 len: 991 time: 1.1689007 Sep 01 17:03:22.508632 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'tag': 'c335b865-32be-49e5-9765-66a2bc067d1e'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:22.510739 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f50dd6fc-f164-4aa8-b1fb-333a40bd140a" -d '{"events": [{"name": "network-changed", "server_uuid": "5e792cf3-d84a-40f8-af00-f4e251c62ed8", "tag": "c335b865-32be-49e5-9765-66a2bc067d1e"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:22.590556 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0baba34c-c2f6-4602-aacb-d49b1ac744d1 x-openstack-request-id: req-0baba34c-c2f6-4602-aacb-d49b1ac744d1 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:22.591086 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5e792cf3-d84a-40f8-af00-f4e251c62ed8", "tag": "c335b865-32be-49e5-9765-66a2bc067d1e", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:22.591592 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-0baba34c-c2f6-4602-aacb-d49b1ac744d1 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:22.592286 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'tag': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'status': 'completed', 'code': 200} Sep 01 17:03:22.593731 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.607059 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ab951243-4254-4532-9d93-c294f4a98543']}} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:22.623317 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bd15a57e-34c6-42ac-abbb-bea94ad6f705') {'for_net_delete': True} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:22.623646 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bd15a57e-34c6-42ac-abbb-bea94ad6f705') {} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:22.634062 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5815145'] for segment, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.654262 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.660530 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-ea6dc582-7227-4fc5-ac5d-d64372dba16b None None] For port 16f42807-e8cd-47da-bb02-a97a89b74a3a, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=16f42807-e8cd-47da-bb02-a97a89b74a3a,segment=NetworkSegment(bd15a57e-34c6-42ac-abbb-bea94ad6f705),segment_id=bd15a57e-34c6-42ac-abbb-bea94ad6f705)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:22.660941 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-ea6dc582-7227-4fc5-ac5d-d64372dba16b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.664773 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Releasing vlan 508 on physical network physnet1 to pool {{(pid=93836) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 17:03:22.664773 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6279874'] for segment, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.665423 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 16f42807-e8cd-47da-bb02-a97a89b74a3a no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: Traceback (most recent call last): Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: timer() Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: cb(*args, **kw) Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: return func(*args, **kwargs) Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: self._notify() Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: self.callback(batched_events) Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: event.method(event) Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: return f(self, *a, **k) Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: return self._get(url).json() Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: return self.request(url, 'GET', **kwargs) Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 17:03:22.666525 dv-cinder-799668-16-iscsi neutron-server[93836]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 17:03:22.682635 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-e1a254c8-6549-40f6-a651-834e7b5abc5d None None] Set router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:22.695036 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 16f42807-e8cd-47da-bb02-a97a89b74a3a {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:03:22.695381 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 16f42807-e8cd-47da-bb02-a97a89b74a3a not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:03:22.695812 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device a4a1a622-487f-4052-a386-30130de5442b no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:03:22.697725 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-ea6dc582-7227-4fc5-ac5d-d64372dba16b None None] Calling delete_port for 16f42807-e8cd-47da-bb02-a97a89b74a3a owned by network:dhcp {{(pid=93837) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:03:22.722189 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: a4a1a622-487f-4052-a386-30130de5442b {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:03:22.722578 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device a4a1a622-487f-4052-a386-30130de5442b not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:03:22.723045 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 21fd7876-56d5-4a25-811b-f3b09625dc9b no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:03:22.742049 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.746002 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 21fd7876-56d5-4a25-811b-f3b09625dc9b {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:03:22.746356 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 21fd7876-56d5-4a25-811b-f3b09625dc9b not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:03:22.749036 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.751684 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] 10.222.0.67 "DELETE /v2.0/networks/ab951243-4254-4532-9d93-c294f4a98543 HTTP/1.1" status: 204 len: 168 time: 0.7233698 Sep 01 17:03:22.754992 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59052) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:22.778899 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e68427bb-cf0d-4cd3-a01c-a615f7bbc9ef admin admin] Pushing event deleted for resources: {'Network': ['ID=ab951243-4254-4532-9d93-c294f4a98543,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:22.891845 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-ea6dc582-7227-4fc5-ac5d-d64372dba16b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377'] for port, after_delete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:22.902021 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-ea6dc582-7227-4fc5-ac5d-d64372dba16b None None] Network ab951243-4254-4532-9d93-c294f4a98543 is not hosted by any dhcp agent {{(pid=93837) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Sep 01 17:03:22.902502 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea6dc582-7227-4fc5-ac5d-d64372dba16b None None] No DVR routers for this DVR port 16f42807-e8cd-47da-bb02-a97a89b74a3a on host dv-cinder-799668-16-iscsi {{(pid=93837) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:03:22.930905 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea6dc582-7227-4fc5-ac5d-d64372dba16b None None] Pushing event deleted for resources: {'Port': ['ID=16f42807-e8cd-47da-bb02-a97a89b74a3a,revision_number=None']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:22.961602 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-e1a254c8-6549-40f6-a651-834e7b5abc5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '3348b2d7-616e-4187-b53c-37f9077d14e3', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'floating_ip_address': '172.27.1.183', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'port_id': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 556, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'mac_address': 'fa:16:3e:96:5a:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:03:07Z', 'updated_at': '2021-09-01T17:03:21Z', 'revision_number': 1, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:39Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:22.988825 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1a254c8-6549-40f6-a651-834e7b5abc5d None None] Checking router: e95cfaf6-7dbf-4e42-af63-5c1ea40c693e for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:03:22.997785 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1a254c8-6549-40f6-a651-834e7b5abc5d None None] Routers {'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:22.998407 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-e1a254c8-6549-40f6-a651-834e7b5abc5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:02:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:23.119332 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59064) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:23.133300 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-e1a254c8-6549-40f6-a651-834e7b5abc5d None None] Set router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:23.213898 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bbbb9b39-feb7-4b3f-b5b8-ab494b1e0264 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1832465'] for router_interface, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.221771 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-11749214-network', 'tenant_id': '0bbcb858ecfd4ebf8ddcdb3f0ee0ca35'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:23.243882 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] Made reservation on behalf of 0bbcb858ecfd4ebf8ddcdb3f0ee0ca35 for: {'network': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:03:23.246186 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.255297 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.354645 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.359808 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.387764 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] vlan segment allocate from pool success with {'vlan_id': 516, 'physical_network': 'physnet1'} {{(pid=93836) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 17:03:23.391394 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-e1a254c8-6549-40f6-a651-834e7b5abc5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '3348b2d7-616e-4187-b53c-37f9077d14e3', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'floating_ip_address': '172.27.1.183', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'port_id': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 556, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'mac_address': 'fa:16:3e:96:5a:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:03:07Z', 'updated_at': '2021-09-01T17:03:21Z', 'revision_number': 1, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:39Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:23.405558 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=adab84f7-bdb1-4f3f-865d-d1b646c5f335,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:23.409303 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.409675 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.segments_db [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] Added segment b4bbb67e-00c9-4060-91ed-752e106d3acb of type vlan for network 42a712e0-c504-45f6-a772-96f7157e5bc3 Sep 01 17:03:23.418348 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1a254c8-6549-40f6-a651-834e7b5abc5d None None] The sync data for ids ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'] in dv-cinder-799668-16-iscsi is: [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '3348b2d7-616e-4187-b53c-37f9077d14e3', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'floating_ip_address': '172.27.1.183', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'port_id': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 556, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'mac_address': 'fa:16:3e:96:5a:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:03:07Z', 'updated_at': '2021-09-01T17:03:21Z', 'revision_number': 1, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:39Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:03:23.459680 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.490854 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.492086 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:23.492769 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.493977 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-bbbb9b39-feb7-4b3f-b5b8-ab494b1e0264 admin admin] Deleting port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:03:23.494318 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bbbb9b39-feb7-4b3f-b5b8-ab494b1e0264 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.553741 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 880 time: 0.4328594 Sep 01 17:03:23.556361 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59068) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:23.561427 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-aa6c4f6f-df37-4c6d-83f1-38e9f9524f24 admin admin] Request body: {'subnet': {'network_id': '42a712e0-c504-45f6-a772-96f7157e5bc3', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-11749214-subnet', 'tenant_id': '0bbcb858ecfd4ebf8ddcdb3f0ee0ca35', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:23.579892 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4420e71d-af45-4a50-b089-9f18b4df4656 admin admin] Pushing event updated for resources: {'Network': ['ID=42a712e0-c504-45f6-a772-96f7157e5bc3,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:23.591626 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network 42a712e0-c504-45f6-a772-96f7157e5bc3 details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 17:03:23.598433 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa6c4f6f-df37-4c6d-83f1-38e9f9524f24 admin admin] Made reservation on behalf of 0bbcb858ecfd4ebf8ddcdb3f0ee0ca35 for: {'subnet': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:03:23.601415 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-aa6c4f6f-df37-4c6d-83f1-38e9f9524f24 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6181104'] for subnet, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.688243 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e49fb78-949e-49a2-a552-d65270ccae11 None None] New status for floating IP 3348b2d7-616e-4187-b53c-37f9077d14e3: ACTIVE {{(pid=93837) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:03:23.808598 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.823183 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-9a15a77e-e83c-4c9c-9727-7c97d0fb2d92 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.831195 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-aa6c4f6f-df37-4c6d-83f1-38e9f9524f24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6280103', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6181094'] for subnet, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.835459 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [None req-bbbb9b39-feb7-4b3f-b5b8-ab494b1e0264 admin admin] For port a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36,segment=NetworkSegment(72428e8d-7584-4a94-9a11-0d3c34cdfd31),segment_id=72428e8d-7584-4a94-9a11-0d3c34cdfd31)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:23.835459 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bbbb9b39-feb7-4b3f-b5b8-ab494b1e0264 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.847505 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-bbbb9b39-feb7-4b3f-b5b8-ab494b1e0264 admin admin] Calling delete_port for a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 owned by network:router_interface {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:03:23.891016 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa6c4f6f-df37-4c6d-83f1-38e9f9524f24 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f7abf916-2e22-4954-874c-6d7775564f14,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:23.899737 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa6c4f6f-df37-4c6d-83f1-38e9f9524f24 admin admin] Checking segment: {'id': 'b4bbb67e-00c9-4060-91ed-752e106d3acb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 516, 'network_id': '42a712e0-c504-45f6-a772-96f7157e5bc3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93836) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:03:23.900092 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa6c4f6f-df37-4c6d-83f1-38e9f9524f24 admin admin] Network hostable DHCP agents. Network: 42a712e0-c504-45f6-a772-96f7157e5bc3, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93836) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 17:03:23.918865 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa6c4f6f-df37-4c6d-83f1-38e9f9524f24 admin admin] Network 42a712e0-c504-45f6-a772-96f7157e5bc3 is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93836) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 17:03:23.929779 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-aa6c4f6f-df37-4c6d-83f1-38e9f9524f24 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, 42a712e0-c504-45f6-a772-96f7157e5bc3) {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:23.934542 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa6c4f6f-df37-4c6d-83f1-38e9f9524f24 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:23.935137 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-aa6c4f6f-df37-4c6d-83f1-38e9f9524f24 admin admin] Notify callbacks [] for subnet, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:23.943489 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97e4771b-ed5e-4880-a5b0-bda97734e28f None None] Network 42a712e0-c504-45f6-a772-96f7157e5bc3 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:03:23.956134 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-aa6c4f6f-df37-4c6d-83f1-38e9f9524f24 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.3987265 Sep 01 17:03:24.060611 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bbbb9b39-feb7-4b3f-b5b8-ab494b1e0264 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:24.083321 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-836ca8c9-2b2e-4ae2-bcec-3817032eeb41 None None] Network 42a712e0-c504-45f6-a772-96f7157e5bc3 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:03:24.097244 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbbb9b39-feb7-4b3f-b5b8-ab494b1e0264 admin admin] Pushing event deleted for resources: {'Port': ['ID=a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:24.216501 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f50dd6fc-f164-4aa8-b1fb-333a40bd140a req-c5f94f9c-4b32-44a4-aff7-35e9bc0926b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:24.218062 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f50dd6fc-f164-4aa8-b1fb-333a40bd140a req-c5f94f9c-4b32-44a4-aff7-35e9bc0926b0 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 1098 time: 0.0599046 Sep 01 17:03:24.389142 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bbbb9b39-feb7-4b3f-b5b8-ab494b1e0264 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611377', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1832589'] for router_interface, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:24.396974 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f50dd6fc-f164-4aa8-b1fb-333a40bd140a req-a5792f16-52be-4e67-8481-68746252b521 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:24.398492 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f50dd6fc-f164-4aa8-b1fb-333a40bd140a req-a5792f16-52be-4e67-8481-68746252b521 service neutron] 10.222.0.69 "GET /v2.0/networks?id=2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 200 len: 917 time: 0.1451607 Sep 01 17:03:24.540099 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f50dd6fc-f164-4aa8-b1fb-333a40bd140a req-0282cbc9-0fc6-461d-9fc3-cd0d601c7675 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c335b865-32be-49e5-9765-66a2bc067d1e HTTP/1.1" status: 200 len: 1001 time: 0.1019607 Sep 01 17:03:24.589741 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:03:24.637647 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f50dd6fc-f164-4aa8-b1fb-333a40bd140a req-783ef2d1-7f28-428d-a373-1f8742678e1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:24.639117 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f50dd6fc-f164-4aa8-b1fb-333a40bd140a req-783ef2d1-7f28-428d-a373-1f8742678e1d service neutron] 10.222.0.69 "GET /v2.0/subnets?id=58fe425a-6b3e-47bd-b5c0-e68ea7782780 HTTP/1.1" status: 200 len: 855 time: 0.0896106 Sep 01 17:03:24.735531 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f50dd6fc-f164-4aa8-b1fb-333a40bd140a req-870ad370-eb66-4109-aa81-11dcc146cadf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:24.737914 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f50dd6fc-f164-4aa8-b1fb-333a40bd140a req-870ad370-eb66-4109-aa81-11dcc146cadf service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2f7bfe5e-0012-467f-ad7f-aea2467233ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0907478 Sep 01 17:03:24.747464 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bbbb9b39-feb7-4b3f-b5b8-ab494b1e0264 admin admin] Router 3c8a9cc5-d161-43ce-bea4-98a58a120590 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:03:24.906162 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:24.913316 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f50dd6fc-f164-4aa8-b1fb-333a40bd140a req-6297e994-3fc2-4df9-af99-5a088526856f service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1677976 Sep 01 17:03:24.946608 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bbbb9b39-feb7-4b3f-b5b8-ab494b1e0264 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:03:24.954971 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83eefe49-11c7-4f79-bd91-49a2de960bc5 None None] Sync routers for ids ['3c8a9cc5-d161-43ce-bea4-98a58a120590'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:03:24.964035 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83eefe49-11c7-4f79-bd91-49a2de960bc5 None None] Routers {'3c8a9cc5-d161-43ce-bea4-98a58a120590'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:24.964941 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-83eefe49-11c7-4f79-bd91-49a2de960bc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:03:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['3c8a9cc5-d161-43ce-bea4-98a58a120590'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:24.977670 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-bbbb9b39-feb7-4b3f-b5b8-ab494b1e0264 admin admin] 10.222.0.67 "PUT /v2.0/routers/3c8a9cc5-d161-43ce-bea4-98a58a120590/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2214985 Sep 01 17:03:24.980281 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59082) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:25.024261 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f50dd6fc-f164-4aa8-b1fb-333a40bd140a req-7ae6a9b9-be5e-4735-a1c1-4cfff7650467 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0974963 Sep 01 17:03:25.078928 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-83eefe49-11c7-4f79-bd91-49a2de960bc5 None None] Set router 3c8a9cc5-d161-43ce-bea4-98a58a120590 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:25.095427 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] Notify callbacks [] for router, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:25.311548 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-83eefe49-11c7-4f79-bd91-49a2de960bc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'name': 'tempest-TestMinimumBasicScenario-1290241884-router', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128'}], 'enable_snat': True}, 'gw_port_id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T17:03:23Z', 'revision_number': 5, 'project_id': '8fa8dccb9985461580f5d9012c082132', 'gw_port': {'id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:fd:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'device_owner': 'network:router_gateway', 'standard_attr_id': 321, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:25.352705 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83eefe49-11c7-4f79-bd91-49a2de960bc5 None None] Checking router: 3c8a9cc5-d161-43ce-bea4-98a58a120590 for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:03:25.362408 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83eefe49-11c7-4f79-bd91-49a2de960bc5 None None] Routers {'3c8a9cc5-d161-43ce-bea4-98a58a120590'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:25.363027 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-83eefe49-11c7-4f79-bd91-49a2de960bc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:03:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['3c8a9cc5-d161-43ce-bea4-98a58a120590'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:25.455237 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:25.467485 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-83eefe49-11c7-4f79-bd91-49a2de960bc5 None None] Set router 3c8a9cc5-d161-43ce-bea4-98a58a120590 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:25.509175 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] Deleting port ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:03:25.509422 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:25.595293 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] For port ba95da00-5d66-47bb-aebe-7e5a4d9f30e1, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=ba95da00-5d66-47bb-aebe-7e5a4d9f30e1,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:25.597239 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:25.615349 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] Calling delete_port for ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 owned by network:router_gateway {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:03:25.744601 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-83eefe49-11c7-4f79-bd91-49a2de960bc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'name': 'tempest-TestMinimumBasicScenario-1290241884-router', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128'}], 'enable_snat': True}, 'gw_port_id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T17:03:23Z', 'revision_number': 5, 'project_id': '8fa8dccb9985461580f5d9012c082132', 'gw_port': {'id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:fd:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'device_owner': 'network:router_gateway', 'standard_attr_id': 321, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:25.774882 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83eefe49-11c7-4f79-bd91-49a2de960bc5 None None] The sync data for ids ['3c8a9cc5-d161-43ce-bea4-98a58a120590'] in dv-cinder-799668-16-iscsi is: [{'id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'name': 'tempest-TestMinimumBasicScenario-1290241884-router', 'tenant_id': '8fa8dccb9985461580f5d9012c082132', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128'}], 'enable_snat': True}, 'gw_port_id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T17:03:23Z', 'revision_number': 5, 'project_id': '8fa8dccb9985461580f5d9012c082132', 'gw_port': {'id': 'ba95da00-5d66-47bb-aebe-7e5a4d9f30e1', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:fd:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c8a9cc5-d161-43ce-bea4-98a58a120590', 'device_owner': 'network:router_gateway', 'standard_attr_id': 321, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:59:39Z', 'updated_at': '2021-09-01T16:59:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:03:25.796622 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:25.826563 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] Pushing event deleted for resources: {'Port': ['ID=ba95da00-5d66-47bb-aebe-7e5a4d9f30e1,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:25.886440 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1827887'] for router_gateway, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.022413 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1821713', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4617'] for router, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.028168 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.086405 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1821722'] for router, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.086839 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3c8a9cc5-d161-43ce-bea4-98a58a120590 {{(pid=93836) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 01 17:03:26.092148 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] Notify callbacks [] for router, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.093272 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-2a41cc7b-332b-4814-b167-85d2afe9d122 admin admin] 10.222.0.67 "DELETE /v2.0/routers/3c8a9cc5-d161-43ce-bea4-98a58a120590 HTTP/1.1" status: 204 len: 168 time: 1.1114526 Sep 01 17:03:26.096451 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59110) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:26.119978 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-176d1757-f2d3-4348-a3ed-5c57f5c9dea8 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:26.122042 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-176d1757-f2d3-4348-a3ed-5c57f5c9dea8 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/networks?id=42a712e0-c504-45f6-a772-96f7157e5bc3 HTTP/1.1" status: 200 len: 807 time: 0.2096364 Sep 01 17:03:26.139626 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-5690ee51-e56f-43cf-bfa3-fe361e8420cd tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/quotas/0bbcb858ecfd4ebf8ddcdb3f0ee0ca35 HTTP/1.1" status: 200 len: 375 time: 0.0097070 Sep 01 17:03:26.148950 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_v2 [None req-1b687700-df5c-4ad8-911f-df073344f885 admin admin] Deleting subnet 9570c867-4a7a-49d3-90c3-267ccaef1997 {{(pid=93835) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 17:03:26.152702 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1b687700-df5c-4ad8-911f-df073344f885 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.174666 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-04f0bd76-4e63-4c97-be4e-0e8fb4c8302a tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=0bbcb858ecfd4ebf8ddcdb3f0ee0ca35&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0278521 Sep 01 17:03:26.191798 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1b687700-df5c-4ad8-911f-df073344f885 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8197692'] for subnet, precommit_delete_associations {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.320737 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-f15d5ecd-11bc-49bf-be8a-e9b832b87074 service neutron] 10.222.0.67 "GET /v2.0/networks/42a712e0-c504-45f6-a772-96f7157e5bc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1394820 Sep 01 17:03:26.323187 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1b687700-df5c-4ad8-911f-df073344f885 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.382166 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1b687700-df5c-4ad8-911f-df073344f885 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7342711', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5120114'] for subnet, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.408557 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b687700-df5c-4ad8-911f-df073344f885 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9570c867-4a7a-49d3-90c3-267ccaef1997,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:26.413133 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-1b687700-df5c-4ad8-911f-df073344f885 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.417680 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-1b687700-df5c-4ad8-911f-df073344f885 admin admin] 10.222.0.67 "DELETE /v2.0/subnets/9570c867-4a7a-49d3-90c3-267ccaef1997 HTTP/1.1" status: 204 len: 168 time: 0.3199794 Sep 01 17:03:26.418285 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59118) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:26.422579 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4b30488-8d7d-44bf-baf4-9a4a290307aa None None] Network c3a21dc6-983b-487a-a63a-0f2feddc0dcf requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:03:26.423267 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-ac26e4dc-6751-438d-ae73-49b5eee2d9a2 service neutron] 10.222.0.67 "GET /v2.0/networks/42a712e0-c504-45f6-a772-96f7157e5bc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0965271 Sep 01 17:03:26.505115 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.558101 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:03:26.595155 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:03:26.596351 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device a3c3c9b3-16fd-4577-a16d-6a8fd6bf0a36 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:03:26.598124 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.602485 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Deleting port 14a1a85f-f795-4fb9-8d79-ffe40773299c {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:03:26.602986 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.630806 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.661993 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7a2f7aea-ff4c-46b9-b9c1-a01bf30d8724 req-f7719b3f-5a1c-43dd-9eb5-b9a0bf1422e9 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 210 time: 0.0468276 Sep 01 17:03:26.676252 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] For port 14a1a85f-f795-4fb9-8d79-ffe40773299c, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=14a1a85f-f795-4fb9-8d79-ffe40773299c,segment=NetworkSegment(72428e8d-7584-4a94-9a11-0d3c34cdfd31),segment_id=72428e8d-7584-4a94-9a11-0d3c34cdfd31)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:26.676712 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.692972 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Calling delete_port for 14a1a85f-f795-4fb9-8d79-ffe40773299c owned by network:dhcp {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:03:26.775388 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.800907 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Pushing event deleted for resources: {'Port': ['ID=14a1a85f-f795-4fb9-8d79-ffe40773299c,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:26.805537 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] No DVR routers for this DVR port 14a1a85f-f795-4fb9-8d79-ffe40773299c on host dv-cinder-799668-16-iscsi {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:03:26.883073 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.887660 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57cd07cc-54bf-4df5-96dc-ddc9562459bb None None] DHCP port deletion for c3a21dc6-983b-487a-a63a-0f2feddc0dcf request from dv-cinder-799668-16-iscsi {{(pid=93837) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 01 17:03:26.895244 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c3a21dc6-983b-487a-a63a-0f2feddc0dcf']}} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:26.908461 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '72428e8d-7584-4a94-9a11-0d3c34cdfd31') {'for_net_delete': True} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:26.908831 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '72428e8d-7584-4a94-9a11-0d3c34cdfd31') {} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:26.918966 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8197639'] for segment, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.934113 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.943431 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Releasing vlan 541 on physical network physnet1 to pool {{(pid=93835) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 17:03:26.944009 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7342797'] for segment, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: Traceback (most recent call last): Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: timer() Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: cb(*args, **kw) Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: return func(*args, **kwargs) Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: self._notify() Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: self.callback(batched_events) Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: event.method(event) Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: return f(self, *a, **k) Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._get(url).json() Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: return self.request(url, 'GET', **kwargs) Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 17:03:26.945732 dv-cinder-799668-16-iscsi neutron-server[93835]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 17:03:27.002163 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:27.006922 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:27.008812 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] 10.222.0.67 "DELETE /v2.0/networks/c3a21dc6-983b-487a-a63a-0f2feddc0dcf HTTP/1.1" status: 204 len: 168 time: 0.5895925 Sep 01 17:03:27.030529 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7972f1af-f07f-4d68-8221-f4f8fe4f3e4f admin admin] Pushing event deleted for resources: {'Network': ['ID=c3a21dc6-983b-487a-a63a-0f2feddc0dcf,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:27.131607 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59134) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:27.175278 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c934d39e-c5ce-48d9-97f7-5aae95d9d57f admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=ccf739a17862469f9bbcedc5abe17cd1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0425282 Sep 01 17:03:27.177917 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59136) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:27.225664 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7b932bd0-ddc5-4002-b094-398f867fc8ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:27.246697 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7b932bd0-ddc5-4002-b094-398f867fc8ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:27.297820 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7b932bd0-ddc5-4002-b094-398f867fc8ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:27.300904 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7b932bd0-ddc5-4002-b094-398f867fc8ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:27.302107 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-7b932bd0-ddc5-4002-b094-398f867fc8ad admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/66d5c8c4-8327-4b83-9ae2-27a6ee182ca6 HTTP/1.1" status: 204 len: 168 time: 0.1232104 Sep 01 17:03:27.310176 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b932bd0-ddc5-4002-b094-398f867fc8ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=66d5c8c4-8327-4b83-9ae2-27a6ee182ca6,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:27.621041 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59144) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:27.659846 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c2919be7-587d-42f4-8cba-21d9bf1b9b9a admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=8fa8dccb9985461580f5d9012c082132&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0376472 Sep 01 17:03:27.662204 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59146) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:27.713419 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-514e57e4-2c79-40c2-84f1-465dfb6b940d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:27.735560 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-514e57e4-2c79-40c2-84f1-465dfb6b940d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:27.786585 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2b02e43b-1d7a-46ce-a83c-ca4b82bbf4d8 req-1d3954a0-dca5-4f77-959b-f7b4cb380cdd tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 210 time: 0.0358515 Sep 01 17:03:27.807562 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-514e57e4-2c79-40c2-84f1-465dfb6b940d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:27.810126 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-514e57e4-2c79-40c2-84f1-465dfb6b940d admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:27.811442 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-514e57e4-2c79-40c2-84f1-465dfb6b940d admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/c0dd0de6-4a20-44b9-9f95-f26f225a56d9 HTTP/1.1" status: 204 len: 168 time: 0.1483781 Sep 01 17:03:27.821266 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-514e57e4-2c79-40c2-84f1-465dfb6b940d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0dd0de6-4a20-44b9-9f95-f26f225a56d9,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:28.467022 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:03:28.479582 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59172) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:28.506582 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:03:28.506931 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device ba95da00-5d66-47bb-aebe-7e5a4d9f30e1 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:03:28.507361 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 14a1a85f-f795-4fb9-8d79-ffe40773299c no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:03:28.540391 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 14a1a85f-f795-4fb9-8d79-ffe40773299c {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:03:28.540766 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 14a1a85f-f795-4fb9-8d79-ffe40773299c not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:03:28.555775 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37cdb482-a8c7-4080-bc6e-569340c72ab8 req-fb1e65a0-ac1a-46f0-87dd-a66f9dc6d31b service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0591996 Sep 01 17:03:28.587275 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-2124785480-network', 'tenant_id': '59475fb517464851810daf1967046d0c'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:28.610046 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] Made reservation on behalf of 59475fb517464851810daf1967046d0c for: {'network': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:03:28.612923 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:28.621542 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:28.648488 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37cdb482-a8c7-4080-bc6e-569340c72ab8 req-efa30376-fbc7-4305-b2d3-4aa52f6688b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:28.650144 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37cdb482-a8c7-4080-bc6e-569340c72ab8 req-efa30376-fbc7-4305-b2d3-4aa52f6688b7 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 1098 time: 0.0422750 Sep 01 17:03:28.713759 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:28.717489 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:28.742393 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] vlan segment allocate from pool success with {'vlan_id': 545, 'physical_network': 'physnet1'} {{(pid=93836) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 17:03:28.752420 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6dab25c-1b35-4d97-b5fa-47f672cdf15b,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:28.757657 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:28.758003 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.segments_db [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] Added segment 7629b231-1a75-4951-b23d-eecb3ccb3fd6 of type vlan for network e985feb4-0a78-4f0e-ad7c-52a73023bf6f Sep 01 17:03:28.787045 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37cdb482-a8c7-4080-bc6e-569340c72ab8 req-bcd6f6a6-82aa-4b18-99b1-1374d7adba1e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:28.788614 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37cdb482-a8c7-4080-bc6e-569340c72ab8 req-bcd6f6a6-82aa-4b18-99b1-1374d7adba1e service neutron] 10.222.0.69 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 912 time: 0.1098986 Sep 01 17:03:28.800624 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:28.827374 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:28.828605 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:28.829358 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:28.864105 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37cdb482-a8c7-4080-bc6e-569340c72ab8 req-b07a552c-e716-4e86-8b70-9818445e80f8 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=b4fb0a19-69a3-49ac-877e-9d08996f0c77 HTTP/1.1" status: 200 len: 1000 time: 0.0675924 Sep 01 17:03:28.906992 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4262483 Sep 01 17:03:28.910562 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59178) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:28.911539 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2ee1659c-6ec5-4911-900d-fe92a6abd346 req-ffc19f6a-649a-4105-81ce-9ed1fed58c13 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 210 time: 0.0368111 Sep 01 17:03:28.915864 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-5d9b67bf-5645-44c0-b1c8-3d9088dcf8d4 admin admin] Request body: {'subnet': {'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-2124785480-subnet', 'tenant_id': '59475fb517464851810daf1967046d0c', 'ip_version': 4}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:28.919015 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-269a81b9-0b6a-459c-a962-6a087fba8f92 admin admin] Pushing event updated for resources: {'Network': ['ID=e985feb4-0a78-4f0e-ad7c-52a73023bf6f,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:28.932180 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network e985feb4-0a78-4f0e-ad7c-52a73023bf6f details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 17:03:28.943219 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37cdb482-a8c7-4080-bc6e-569340c72ab8 req-3e4c2206-b7a8-45a3-bd38-9b1f4cfc6ca9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:28.944768 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37cdb482-a8c7-4080-bc6e-569340c72ab8 req-3e4c2206-b7a8-45a3-bd38-9b1f4cfc6ca9 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 200 len: 850 time: 0.0733612 Sep 01 17:03:28.962819 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5d9b67bf-5645-44c0-b1c8-3d9088dcf8d4 admin admin] Made reservation on behalf of 59475fb517464851810daf1967046d0c for: {'subnet': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:03:28.965012 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5d9b67bf-5645-44c0-b1c8-3d9088dcf8d4 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5120093'] for subnet, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:29.349765 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37cdb482-a8c7-4080-bc6e-569340c72ab8 req-126af663-447d-454c-a193-e879b5dcaea6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:29.351240 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37cdb482-a8c7-4080-bc6e-569340c72ab8 req-126af663-447d-454c-a193-e879b5dcaea6 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=35c995f2-96ec-4a35-9f59-05221a09df3f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.3978808 Sep 01 17:03:29.502812 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-d74b9edc-6432-4af0-9d87-7802e7ec0c15 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:29.504352 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-d74b9edc-6432-4af0-9d87-7802e7ec0c15 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.69 "GET /v2.0/networks?id=42a712e0-c504-45f6-a772-96f7157e5bc3 HTTP/1.1" status: 200 len: 807 time: 0.4671218 Sep 01 17:03:29.558982 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-8abcc5e7-ba90-4cf6-9416-de1fb44ed301 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Request body: {'port': {'device_id': '1c9dda17-56fd-454e-971d-8971bacf4d44', 'network_id': '42a712e0-c504-45f6-a772-96f7157e5bc3', 'admin_state_up': True, 'tenant_id': '0bbcb858ecfd4ebf8ddcdb3f0ee0ca35'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:29.572521 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37cdb482-a8c7-4080-bc6e-569340c72ab8 req-1e7b700d-8b0b-40cd-b249-84549c15d446 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2104621 Sep 01 17:03:29.680174 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5d9b67bf-5645-44c0-b1c8-3d9088dcf8d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7343016', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5120075'] for subnet, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:29.802089 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d9b67bf-5645-44c0-b1c8-3d9088dcf8d4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=53347cb0-0e42-4047-9ec0-95b809608613,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:29.812936 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37cdb482-a8c7-4080-bc6e-569340c72ab8 req-003e1ff0-83e0-4852-9ad5-eb92bdfffb0b service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2280338 Sep 01 17:03:29.824901 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d9b67bf-5645-44c0-b1c8-3d9088dcf8d4 admin admin] Checking segment: {'id': '7629b231-1a75-4951-b23d-eecb3ccb3fd6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:03:29.825258 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d9b67bf-5645-44c0-b1c8-3d9088dcf8d4 admin admin] Network hostable DHCP agents. Network: e985feb4-0a78-4f0e-ad7c-52a73023bf6f, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93835) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 17:03:29.834058 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-8abcc5e7-ba90-4cf6-9416-de1fb44ed301 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Made reservation on behalf of 0bbcb858ecfd4ebf8ddcdb3f0ee0ca35 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:03:29.837560 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-8abcc5e7-ba90-4cf6-9416-de1fb44ed301 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:29.868274 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d9b67bf-5645-44c0-b1c8-3d9088dcf8d4 admin admin] Network e985feb4-0a78-4f0e-ad7c-52a73023bf6f is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93835) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 17:03:29.906046 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-5d9b67bf-5645-44c0-b1c8-3d9088dcf8d4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, e985feb4-0a78-4f0e-ad7c-52a73023bf6f) {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:29.916055 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d9b67bf-5645-44c0-b1c8-3d9088dcf8d4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:29.916645 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5d9b67bf-5645-44c0-b1c8-3d9088dcf8d4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:29.917073 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cd79427-fb29-493e-8d3d-9b31fa40814d None None] Network e985feb4-0a78-4f0e-ad7c-52a73023bf6f requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:03:29.936929 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-5d9b67bf-5645-44c0-b1c8-3d9088dcf8d4 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.0251563 Sep 01 17:03:29.939928 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59194) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:29.944975 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:30.005638 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1827089', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4631'] for router, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.006921 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1833975', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1833092', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1830247', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4608'] for router, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.015962 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7066c7b7-dfbb-4120-a095-398562a3ccb4 req-46ee34c0-8a97-4d18-8275-0e687fb35ea3 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 210 time: 0.0305192 Sep 01 17:03:30.024632 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-8abcc5e7-ba90-4cf6-9416-de1fb44ed301 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Allocated IP 172.20.0.9 (42a712e0-c504-45f6-a772-96f7157e5bc3/f7abf916-2e22-4954-874c-6d7775564f14/72467e76-4867-467f-bdb2-3d1d360cfd19) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:03:30.089170 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ce91fdb-f9d4-529e-8715-29775a2007ca-e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'tenant_id': '59475fb517464851810daf1967046d0c', 'fixed_ips': [{'subnet_id': '53347cb0-0e42-4047-9ec0-95b809608613'}]}} from dv-cinder-799668-16-iscsi. {{(pid=93837) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 01 17:03:30.090094 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.100271 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.224485 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.db_base_plugin_common [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Allocated IP 172.20.0.2 (e985feb4-0a78-4f0e-ad7c-52a73023bf6f/53347cb0-0e42-4047-9ec0-95b809608613/194f0b8b-5439-4609-9cd0-d95d6fc8e621) {{(pid=93837) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:03:30.312243 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.367137 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Notify callbacks [] for port, precommit_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.376065 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Transition to ACTIVE for port object 194f0b8b-5439-4609-9cd0-d95d6fc8e621 will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:30.391549 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Transition to ACTIVE for port object 194f0b8b-5439-4609-9cd0-d95d6fc8e621 will not be triggered until provisioned by entity DHCP. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:30.398477 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.416063 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-8abcc5e7-ba90-4cf6-9416-de1fb44ed301 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.441126 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Network e985feb4-0a78-4f0e-ad7c-52a73023bf6f is already hosted by enough agents. {{(pid=93837) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:03:30.443912 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.base_scheduler [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Resources bound (agent type, host, resource id): {{(pid=93837) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:30.446532 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Received port after_create {{(pid=93837) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:03:30.455131 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Pushing event updated for resources: {'Port': ['ID=194f0b8b-5439-4609-9cd0-d95d6fc8e621,revision_number=1']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:30.482841 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-8abcc5e7-ba90-4cf6-9416-de1fb44ed301 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.508206 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Attempting to bind port 194f0b8b-5439-4609-9cd0-d95d6fc8e621 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:03:30.508569 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Attempting to bind port 194f0b8b-5439-4609-9cd0-d95d6fc8e621 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '7629b231-1a75-4951-b23d-eecb3ccb3fd6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:03:30.508926 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Attempting to bind port 194f0b8b-5439-4609-9cd0-d95d6fc8e621 on network e985feb4-0a78-4f0e-ad7c-52a73023bf6f {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:03:30.513789 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 3, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:03:30.514149 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Checking segment: {'id': '7629b231-1a75-4951-b23d-eecb3ccb3fd6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:03:30.514545 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.514934 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Bound using segment: {'id': '7629b231-1a75-4951-b23d-eecb3ccb3fd6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:03:30.515392 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Bound port: 194f0b8b-5439-4609-9cd0-d95d6fc8e621, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7629b231-1a75-4951-b23d-eecb3ccb3fd6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:03:30.515771 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.586715 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-8abcc5e7-ba90-4cf6-9416-de1fb44ed301 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Network 42a712e0-c504-45f6-a772-96f7157e5bc3 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:03:30.588329 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] For port 194f0b8b-5439-4609-9cd0-d95d6fc8e621, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:03:30.593139 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] For port 194f0b8b-5439-4609-9cd0-d95d6fc8e621, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=194f0b8b-5439-4609-9cd0-d95d6fc8e621,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:03:30.596141 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-8abcc5e7-ba90-4cf6-9416-de1fb44ed301 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:30.605932 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-8abcc5e7-ba90-4cf6-9416-de1fb44ed301 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:03:30.608846 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.632817 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8abcc5e7-ba90-4cf6-9416-de1fb44ed301 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Pushing event updated for resources: {'Port': ['ID=72467e76-4867-467f-bdb2-3d1d360cfd19,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:30.675837 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58577237-4072-4122-ad62-ddb0b1309596 None None] Pushing event updated for resources: {'Port': ['ID=194f0b8b-5439-4609-9cd0-d95d6fc8e621,revision_number=2']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:30.686548 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-8abcc5e7-ba90-4cf6-9416-de1fb44ed301 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:30.687195 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-8abcc5e7-ba90-4cf6-9416-de1fb44ed301 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.697127 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.721344 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.727505 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-8abcc5e7-ba90-4cf6-9416-de1fb44ed301 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1737123 Sep 01 17:03:30.742203 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Request body: {'port': {'device_id': '1c9dda17-56fd-454e-971d-8971bacf4d44', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:30.872725 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:30.929337 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Allocated IP 172.27.1.75 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/bc0c4eb8-de3a-41c7-8977-ea220855327a) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:03:31.139248 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ada3b38-9623-40b9-9705-dc6f82b0c5df req-6bcb8c8f-5744-4817-b133-3f51e891c599 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:31.140902 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5ada3b38-9623-40b9-9705-dc6f82b0c5df req-6bcb8c8f-5744-4817-b133-3f51e891c599 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 931 time: 0.0500844 Sep 01 17:03:31.156098 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:31.181207 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5ada3b38-9623-40b9-9705-dc6f82b0c5df req-3273a0d3-2541-4e18-ba41-0133bd7f56a5 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0334020 Sep 01 17:03:31.263542 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:31.294216 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 72467e76-4867-467f-bdb2-3d1d360cfd19 {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:03:31.307762 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:31.320962 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:03:31.328156 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:31.330752 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:03:31.359002 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Pushing event updated for resources: {'Port': ['ID=bc0c4eb8-de3a-41c7-8977-ea220855327a,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:31.362778 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Transition to ACTIVE for port object 72467e76-4867-467f-bdb2-3d1d360cfd19 will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:31.371600 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:31.519570 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Pushing event updated for resources: {'Port': ['ID=72467e76-4867-467f-bdb2-3d1d360cfd19,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:31.547075 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09e29cd2-e8dc-4621-88bf-b837b6c21e37 None None] Network e985feb4-0a78-4f0e-ad7c-52a73023bf6f requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:03:31.613688 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-54ea2e55-f85a-4909-886c-2087440c83a5 None None] Provisioning for port 194f0b8b-5439-4609-9cd0-d95d6fc8e621 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:31.618592 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Attempting to bind port 72467e76-4867-467f-bdb2-3d1d360cfd19 on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:03:31.619111 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Attempting to bind port 72467e76-4867-467f-bdb2-3d1d360cfd19 by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': 'b4bbb67e-00c9-4060-91ed-752e106d3acb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 516, 'network_id': '42a712e0-c504-45f6-a772-96f7157e5bc3'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:03:31.619269 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Attempting to bind port 72467e76-4867-467f-bdb2-3d1d360cfd19 on network 42a712e0-c504-45f6-a772-96f7157e5bc3 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:03:31.657099 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Port 72467e76-4867-467f-bdb2-3d1d360cfd19 on network 42a712e0-c504-45f6-a772-96f7157e5bc3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:03:31.657479 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Attempting to bind port 72467e76-4867-467f-bdb2-3d1d360cfd19 on network 42a712e0-c504-45f6-a772-96f7157e5bc3 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:03:31.667147 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 3, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:03:31.667493 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Checking segment: {'id': 'b4bbb67e-00c9-4060-91ed-752e106d3acb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 516, 'network_id': '42a712e0-c504-45f6-a772-96f7157e5bc3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:03:31.667891 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Bound using segment: {'id': 'b4bbb67e-00c9-4060-91ed-752e106d3acb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 516, 'network_id': '42a712e0-c504-45f6-a772-96f7157e5bc3'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:03:31.668348 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Bound port: 72467e76-4867-467f-bdb2-3d1d360cfd19, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b4bbb67e-00c9-4060-91ed-752e106d3acb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 516, 'network_id': '42a712e0-c504-45f6-a772-96f7157e5bc3'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:03:31.668718 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:32.037069 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:32.078943 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] For port 72467e76-4867-467f-bdb2-3d1d360cfd19, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:03:32.097530 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] For port 72467e76-4867-467f-bdb2-3d1d360cfd19, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=72467e76-4867-467f-bdb2-3d1d360cfd19,segment=NetworkSegment(b4bbb67e-00c9-4060-91ed-752e106d3acb),segment_id=b4bbb67e-00c9-4060-91ed-752e106d3acb)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:03:32.102400 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:32.175109 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:32.175727 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:32.177129 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] 10.222.0.69 "PUT /v2.0/ports/72467e76-4867-467f-bdb2-3d1d360cfd19 HTTP/1.1" status: 200 len: 1093 time: 1.4396055 Sep 01 17:03:32.179277 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c9dda17-56fd-454e-971d-8971bacf4d44', 'tag': '72467e76-4867-467f-bdb2-3d1d360cfd19'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:32.181528 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b82e2208-9c67-454c-8958-84e1c0a2026e" -d '{"events": [{"name": "network-changed", "server_uuid": "1c9dda17-56fd-454e-971d-8971bacf4d44", "tag": "72467e76-4867-467f-bdb2-3d1d360cfd19"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:32.249536 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a93d15b-1a28-4651-ae8b-676a759fbda3 x-openstack-request-id: req-9a93d15b-1a28-4651-ae8b-676a759fbda3 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:32.249845 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c9dda17-56fd-454e-971d-8971bacf4d44", "tag": "72467e76-4867-467f-bdb2-3d1d360cfd19", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:32.250087 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-9a93d15b-1a28-4651-ae8b-676a759fbda3 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:32.250590 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c9dda17-56fd-454e-971d-8971bacf4d44', 'tag': '72467e76-4867-467f-bdb2-3d1d360cfd19', 'status': 'completed', 'code': 200} Sep 01 17:03:32.273554 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59000de3-c48f-4cea-8821-b209d256b600 service neutron] Pushing event updated for resources: {'Port': ['ID=72467e76-4867-467f-bdb2-3d1d360cfd19,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:32.317655 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d97c63b4-3241-41bf-be7f-b68c057ad57d req-80f761fd-e87c-4b68-a2c4-7fc09c6e5643 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:32.319306 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d97c63b4-3241-41bf-be7f-b68c057ad57d req-80f761fd-e87c-4b68-a2c4-7fc09c6e5643 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 943 time: 0.0549881 Sep 01 17:03:32.328290 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-e2892942-9ac9-4328-be79-9ac33093352a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:32.331359 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-e2892942-9ac9-4328-be79-9ac33093352a service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0bbcb858ecfd4ebf8ddcdb3f0ee0ca35&device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 1096 time: 0.0930884 Sep 01 17:03:32.358184 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d97c63b4-3241-41bf-be7f-b68c057ad57d req-4983feb7-bd75-42b9-b87b-c79c001d3114 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325415 Sep 01 17:03:32.385234 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1833934', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1833207'] for router, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:32.388035 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-28abd75a-4a97-4cc6-91ea-3abdbf5aa6ba service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=72467e76-4867-467f-bdb2-3d1d360cfd19 HTTP/1.1" status: 200 len: 217 time: 0.0445693 Sep 01 17:03:32.484855 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 194f0b8b-5439-4609-9cd0-d95d6fc8e621 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:32.508024 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-786a67f8-f6df-4e53-8132-2257e7bb3d1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:32.509528 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-786a67f8-f6df-4e53-8132-2257e7bb3d1c service neutron] 10.222.0.69 "GET /v2.0/subnets?id=f7abf916-2e22-4954-874c-6d7775564f14 HTTP/1.1" status: 200 len: 847 time: 0.0869310 Sep 01 17:03:32.532229 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 194f0b8b-5439-4609-9cd0-d95d6fc8e621 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:32.536013 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 194f0b8b-5439-4609-9cd0-d95d6fc8e621 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:32.536379 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:32.552242 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-d4c1c442-05ed-4962-a596-17a3250e7cda service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=42a712e0-c504-45f6-a772-96f7157e5bc3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0324440 Sep 01 17:03:32.610515 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:32.629678 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc is scheduled to L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c with binding_index 1 {{(pid=93835) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 01 17:03:32.644714 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port 194f0b8b-5439-4609-9cd0-d95d6fc8e621, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=194f0b8b-5439-4609-9cd0-d95d6fc8e621,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:32.648671 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:32.700406 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=194f0b8b-5439-4609-9cd0-d95d6fc8e621,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:32.703873 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-db23b1f7-1834-48a9-9bf9-e5775de796fa service neutron] 10.222.0.69 "GET /v2.0/networks/42a712e0-c504-45f6-a772-96f7157e5bc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1427646 Sep 01 17:03:32.851853 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:03:32.863722 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Sync routers for ids ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:03:32.873704 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Routers {'88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:32.874483 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:03:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:32.883441 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] Notify callbacks [] for router, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:32.884423 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-8564957d-e4cf-4aff-964f-ade3735082c3 admin admin] 10.222.0.67 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.9430311 Sep 01 17:03:32.887240 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59226) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:32.890473 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-6f158386-82fb-41a2-afb6-1a3129c9ccdd req-08eb5456-fdc8-482f-a5cf-7ceef8eee57f service neutron] 10.222.0.69 "GET /v2.0/networks/42a712e0-c504-45f6-a772-96f7157e5bc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1509123 Sep 01 17:03:33.028758 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Set router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:33.074425 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b82e2208-9c67-454c-8958-84e1c0a2026e req-5d1e2942-5586-47e4-b685-37eb6a55f2bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:33.076143 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b82e2208-9c67-454c-8958-84e1c0a2026e req-5d1e2942-5586-47e4-b685-37eb6a55f2bb service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0bbcb858ecfd4ebf8ddcdb3f0ee0ca35&device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 1096 time: 0.1271994 Sep 01 17:03:33.176510 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b82e2208-9c67-454c-8958-84e1c0a2026e req-86be4913-2085-4b1d-8dfe-8077c06b37a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:33.178083 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b82e2208-9c67-454c-8958-84e1c0a2026e req-86be4913-2085-4b1d-8dfe-8077c06b37a2 service neutron] 10.222.0.69 "GET /v2.0/networks?id=42a712e0-c504-45f6-a772-96f7157e5bc3 HTTP/1.1" status: 200 len: 908 time: 0.0938132 Sep 01 17:03:33.224558 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b82e2208-9c67-454c-8958-84e1c0a2026e req-625bd77a-e784-4991-9233-2b29375dc20e service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=72467e76-4867-467f-bdb2-3d1d360cfd19 HTTP/1.1" status: 200 len: 217 time: 0.0382664 Sep 01 17:03:33.229798 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75'}], 'enable_snat': True}, 'gw_port_id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:31Z', 'revision_number': 3, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port': {'id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:f8:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:30Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:33.255426 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Checking router: 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:03:33.255781 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Updating router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc port bc0c4eb8-de3a-41c7-8977-ea220855327a binding host dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 17:03:33.281153 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:33.282330 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b82e2208-9c67-454c-8958-84e1c0a2026e req-7b3fb5aa-6324-43fe-bd23-e7ab656280b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:33.284946 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b82e2208-9c67-454c-8958-84e1c0a2026e req-7b3fb5aa-6324-43fe-bd23-e7ab656280b9 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=f7abf916-2e22-4954-874c-6d7775564f14 HTTP/1.1" status: 200 len: 847 time: 0.0515997 Sep 01 17:03:33.322117 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b82e2208-9c67-454c-8958-84e1c0a2026e req-e1f9e721-3023-485b-8a93-5eae68c5183d service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=42a712e0-c504-45f6-a772-96f7157e5bc3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0254664 Sep 01 17:03:33.408163 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:33.434343 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b82e2208-9c67-454c-8958-84e1c0a2026e req-4ee0fcd5-0405-4ade-babb-72f60cd7de19 service neutron] 10.222.0.69 "GET /v2.0/networks/42a712e0-c504-45f6-a772-96f7157e5bc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0940542 Sep 01 17:03:33.552191 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b82e2208-9c67-454c-8958-84e1c0a2026e req-666766dd-b65c-40bc-b788-b4868d49043c service neutron] 10.222.0.69 "GET /v2.0/networks/42a712e0-c504-45f6-a772-96f7157e5bc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1069329 Sep 01 17:03:33.560881 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c780be7-0aff-4e68-8b24-dd9edf0d008d req-935fbf12-b52b-4ee4-be3d-afe796bf6b03 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:33.562405 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4c780be7-0aff-4e68-8b24-dd9edf0d008d req-935fbf12-b52b-4ee4-be3d-afe796bf6b03 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 943 time: 0.0980358 Sep 01 17:03:33.636513 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4c780be7-0aff-4e68-8b24-dd9edf0d008d req-ed01a8f5-87c9-4899-b95b-f41555c76ff0 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0660226 Sep 01 17:03:33.643427 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Allocated IP 172.20.0.1 (e985feb4-0a78-4f0e-ad7c-52a73023bf6f/53347cb0-0e42-4047-9ec0-95b809608613/b3f5695a-1b76-4688-983b-02a2efc00c3e) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:03:33.689785 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Notify callbacks [] for port, precommit_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:33.699572 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Transition to ACTIVE for port object bc0c4eb8-de3a-41c7-8977-ea220855327a will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:33.706779 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:33.765840 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:33.770946 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Attempting to bind port bc0c4eb8-de3a-41c7-8977-ea220855327a on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:03:33.771324 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Attempting to bind port bc0c4eb8-de3a-41c7-8977-ea220855327a by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:03:33.771691 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Attempting to bind port bc0c4eb8-de3a-41c7-8977-ea220855327a on network e28b8145-06a4-43a8-a9f2-9a7014f96a23 {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:03:33.775565 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b4e3f67-b629-4dfe-9f82-64530b45dafc None None] Pushing event updated for resources: {'Port': ['ID=bc0c4eb8-de3a-41c7-8977-ea220855327a,revision_number=2']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:33.781671 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.provisioning_blocks [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Transition to ACTIVE for port object b3f5695a-1b76-4688-983b-02a2efc00c3e will not be triggered until provisioned by entity DHCP. {{(pid=93836) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:33.784061 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 3, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:03:33.784475 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Checking segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:03:33.785064 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:33.785622 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Bound using segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:03:33.786582 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Bound port: bc0c4eb8-de3a-41c7-8977-ea220855327a, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:03:33.786582 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:33.821235 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:33.844169 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] For port bc0c4eb8-de3a-41c7-8977-ea220855327a, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:03:33.847871 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] For port bc0c4eb8-de3a-41c7-8977-ea220855327a, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=bc0c4eb8-de3a-41c7-8977-ea220855327a,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:03:33.852020 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:33.865803 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Network e985feb4-0a78-4f0e-ad7c-52a73023bf6f is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:03:33.870613 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:33.873181 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:03:33.910426 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Pushing event updated for resources: {'Port': ['ID=b3f5695a-1b76-4688-983b-02a2efc00c3e,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:33.914827 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Routers {'88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:33.915462 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:03:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:33.927042 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1827972'] for router_interface, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:33.954059 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b4e3f67-b629-4dfe-9f82-64530b45dafc None None] Pushing event updated for resources: {'Port': ['ID=bc0c4eb8-de3a-41c7-8977-ea220855327a,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:34.043590 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] Set router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:34.063887 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:34.203907 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-330a6cbb-6f0c-44a9-92cf-0f37631bc204 None None] Provisioning for port b3f5695a-1b76-4688-983b-02a2efc00c3e completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:34.208794 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-330a6cbb-6f0c-44a9-92cf-0f37631bc204 None None] Provisioning complete for port b3f5695a-1b76-4688-983b-02a2efc00c3e triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:34.209170 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-330a6cbb-6f0c-44a9-92cf-0f37631bc204 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:34.269224 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-330a6cbb-6f0c-44a9-92cf-0f37631bc204 None None] Port b3f5695a-1b76-4688-983b-02a2efc00c3e cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:03:34.272974 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Notify callbacks [] for port, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:34.278945 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6279726'] for port, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:34.294802 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75'}], 'enable_snat': True}, 'gw_port_id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:31Z', 'revision_number': 3, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port': {'id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:f8:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:34.333555 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-399c2309-e719-4b0b-b9fe-67b1d0f1b836 None None] The sync data for ids ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'] in dv-cinder-799668-16-iscsi is: [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75'}], 'enable_snat': True}, 'gw_port_id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:31Z', 'revision_number': 3, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port': {'id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:f8:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:03:34.382672 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611336', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1832500'] for router_interface, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:34.384381 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Pushing event updated for resources: {'Port': ['ID=b3f5695a-1b76-4688-983b-02a2efc00c3e,revision_number=2']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:34.448461 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce932b87-fd6d-4ff7-8e03-3f5ec20740ce req-f73cf577-f847-4e76-83e5-296a6fe40b9b tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:34.450023 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ce932b87-fd6d-4ff7-8e03-3f5ec20740ce req-f73cf577-f847-4e76-83e5-296a6fe40b9b tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 945 time: 0.1048236 Sep 01 17:03:34.471998 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 194f0b8b-5439-4609-9cd0-d95d6fc8e621 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:34.517776 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ce932b87-fd6d-4ff7-8e03-3f5ec20740ce req-6998d5b7-cd35-4321-ac5d-d01a7a8e6029 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599723 Sep 01 17:03:34.524329 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 194f0b8b-5439-4609-9cd0-d95d6fc8e621 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:34.524751 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:34.530687 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Network e985feb4-0a78-4f0e-ad7c-52a73023bf6f is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:03:34.532117 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:34.612742 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 72467e76-4867-467f-bdb2-3d1d360cfd19 details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:03:34.695805 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:03:34.802645 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 72467e76-4867-467f-bdb2-3d1d360cfd19, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=72467e76-4867-467f-bdb2-3d1d360cfd19,segment=NetworkSegment(b4bbb67e-00c9-4060-91ed-752e106d3acb),segment_id=b4bbb67e-00c9-4060-91ed-752e106d3acb)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:34.816946 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': '72467e76-4867-467f-bdb2-3d1d360cfd19', 'network_id': '42a712e0-c504-45f6-a772-96f7157e5bc3', 'port_id': '72467e76-4867-467f-bdb2-3d1d360cfd19', 'mac_address': 'fa:16:3e:c3:64:16', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 516, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f7abf916-2e22-4954-874c-6d7775564f14', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:03:34.856775 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:34.862423 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55bed29f-520a-4982-8abc-85940a8aaf02 req-464d6a09-8055-458c-80d9-e8b0e4d566fa tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:34.864071 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-55bed29f-520a-4982-8abc-85940a8aaf02 req-464d6a09-8055-458c-80d9-e8b0e4d566fa tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 943 time: 0.1154814 Sep 01 17:03:34.870845 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 72467e76-4867-467f-bdb2-3d1d360cfd19 {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:03:34.877908 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:03:34.893054 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 72467e76-4867-467f-bdb2-3d1d360cfd19, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=72467e76-4867-467f-bdb2-3d1d360cfd19,segment=NetworkSegment(b4bbb67e-00c9-4060-91ed-752e106d3acb),segment_id=b4bbb67e-00c9-4060-91ed-752e106d3acb)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:34.898423 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-b273daf2-a127-4bb7-b8c1-e407cf13dfe2 admin admin] 10.222.0.67 "PUT /v2.0/routers/88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0038009 Sep 01 17:03:34.900925 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:34.929754 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-55bed29f-520a-4982-8abc-85940a8aaf02 req-22a5b102-8b5a-45e6-8595-819ca7c8746d tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0591924 Sep 01 17:03:34.950779 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-de98086d-5d20-4163-9020-e5193e6744d4 None None] Provisioning complete for port b3f5695a-1b76-4688-983b-02a2efc00c3e triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:34.951158 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-de98086d-5d20-4163-9020-e5193e6744d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:34.992224 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=72467e76-4867-467f-bdb2-3d1d360cfd19,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:34.998296 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-de98086d-5d20-4163-9020-e5193e6744d4 None None] Port b3f5695a-1b76-4688-983b-02a2efc00c3e cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:03:35.162018 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['72467e76-4867-467f-bdb2-3d1d360cfd19'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:03:35.420232 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59264) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:35.425498 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-531980329-network', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:35.445219 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] Made reservation on behalf of a7a2f1ded52e47fbabc7384bca188240 for: {'network': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:03:35.447529 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:35.456294 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:35.547281 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:35.552087 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:35.576979 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] vlan segment allocate from pool success with {'vlan_id': 546, 'physical_network': 'physnet1'} {{(pid=93836) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 17:03:35.587498 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0775e657-1ebf-4905-94d7-1f1563246d80,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:35.593289 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:35.593665 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.segments_db [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] Added segment 125e7130-5134-4c18-b009-f88603063dcb of type vlan for network da82e365-d8f6-432c-8d68-9fd1f25319ca Sep 01 17:03:35.669557 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:35.680485 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3195f454-9a22-49ae-8337-820e0919fddd req-f77cc01b-7208-49b5-a5ae-e0c7068a857d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:35.682006 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3195f454-9a22-49ae-8337-820e0919fddd req-f77cc01b-7208-49b5-a5ae-e0c7068a857d tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 945 time: 0.0903277 Sep 01 17:03:35.720957 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:35.721976 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:35.722662 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:35.752740 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3195f454-9a22-49ae-8337-820e0919fddd req-23943056-a859-47b6-b31e-9720beba5a05 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/security-groups?id=88fc5a2a-1857-470b-a3f9-70d8551b6f2f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0622730 Sep 01 17:03:35.788744 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.3673787 Sep 01 17:03:35.791776 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59268) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:35.795598 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1adacdf7-1934-4325-896a-8144db2e95df admin admin] Pushing event updated for resources: {'Network': ['ID=da82e365-d8f6-432c-8d68-9fd1f25319ca,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:35.797498 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Request body: {'subnet': {'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-531980329-subnet', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'ip_version': 4}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:35.805862 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network da82e365-d8f6-432c-8d68-9fd1f25319ca details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 17:03:35.828944 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Made reservation on behalf of a7a2f1ded52e47fbabc7384bca188240 for: {'subnet': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:03:35.832306 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5120093'] for subnet, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.024740 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Sync routers for ids ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:03:36.035682 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Routers {'88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:36.036314 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-41038082-0035-4def-b67d-60e44a931f93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:03:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:36.041069 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7343016', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5120075'] for subnet, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.076664 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f863b62a-b4d8-4444-b674-912a913ab773 req-859dc17d-8f00-467c-aab7-56f18bdbbc2b tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:36.078172 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f863b62a-b4d8-4444-b674-912a913ab773 req-859dc17d-8f00-467c-aab7-56f18bdbbc2b tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 944 time: 0.0745282 Sep 01 17:03:36.120214 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd8dea5-6cfb-4eb6-b476-a961f3b50378 req-851cc304-b281-43d5-9dc8-9cc7fd1fed02 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:36.120446 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f863b62a-b4d8-4444-b674-912a913ab773 req-15f8f22c-5515-4f47-8d06-31e6cfd11951 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0347679 Sep 01 17:03:36.121739 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-dbd8dea5-6cfb-4eb6-b476-a961f3b50378 req-851cc304-b281-43d5-9dc8-9cc7fd1fed02 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.69 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 945 time: 0.1195199 Sep 01 17:03:36.122978 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:36.136232 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.136760 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.137109 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.137470 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.137801 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.138129 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.138614 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.139082 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.139547 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.140023 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.140507 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.140838 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.151447 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Checking segment: {'id': '125e7130-5134-4c18-b009-f88603063dcb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:03:36.151814 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Network hostable DHCP agents. Network: da82e365-d8f6-432c-8d68-9fd1f25319ca, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93835) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 17:03:36.152310 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Set router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:36.220397 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Network da82e365-d8f6-432c-8d68-9fd1f25319ca is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93835) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 17:03:36.232864 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, da82e365-d8f6-432c-8d68-9fd1f25319ca) {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:36.240733 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:36.241327 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.241469 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d4fac2c-6635-4733-a7bc-a29f6111b251 None None] Network da82e365-d8f6-432c-8d68-9fd1f25319ca requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:03:36.264210 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59272) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:36.264452 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-b10c4497-ea40-4752-867b-e55720f7eef9 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.4714413 Sep 01 17:03:36.270615 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-531980329-router', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:36.271882 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-dbd8dea5-6cfb-4eb6-b476-a961f3b50378 req-ba5191ee-b298-414b-afab-9859d9c801dc tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Deleting port efd56e04-713d-49e6-9f93-b6c33f23c45b {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:03:36.272553 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-dbd8dea5-6cfb-4eb6-b476-a961f3b50378 req-ba5191ee-b298-414b-afab-9859d9c801dc tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.296675 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1827089', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4631'] for router, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.300103 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1833975', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1833092', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1830247', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4608'] for router, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.372815 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-41038082-0035-4def-b67d-60e44a931f93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75'}], 'enable_snat': True}, 'gw_port_id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:34Z', 'revision_number': 4, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port': {'id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:f8:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'b3f5695a-1b76-4688-983b-02a2efc00c3e', 'name': '', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'tenant_id': '59475fb517464851810daf1967046d0c', 'mac_address': 'fa:16:3e:1b:db:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 603, 'fixed_ips': [{'subnet_id': '53347cb0-0e42-4047-9ec0-95b809608613', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:33Z', 'updated_at': '2021-09-01T17:03:34Z', 'revision_number': 2, 'project_id': '59475fb517464851810daf1967046d0c', 'subnets': [{'id': '53347cb0-0e42-4047-9ec0-95b809608613', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:36.377076 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-dbd8dea5-6cfb-4eb6-b476-a961f3b50378 req-ba5191ee-b298-414b-afab-9859d9c801dc tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] For port efd56e04-713d-49e6-9f93-b6c33f23c45b, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=efd56e04-713d-49e6-9f93-b6c33f23c45b,segment=NetworkSegment(908c9756-53a1-4c99-846c-262c66bbb074),segment_id=908c9756-53a1-4c99-846c-262c66bbb074)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:36.377612 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-dbd8dea5-6cfb-4eb6-b476-a961f3b50378 req-ba5191ee-b298-414b-afab-9859d9c801dc tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.379020 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.405117 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Checking router: 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:03:36.405375 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Updating router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc port b3f5695a-1b76-4688-983b-02a2efc00c3e binding host dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 17:03:36.418933 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-dbd8dea5-6cfb-4eb6-b476-a961f3b50378 req-ba5191ee-b298-414b-afab-9859d9c801dc tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Calling delete_port for efd56e04-713d-49e6-9f93-b6c33f23c45b owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:03:36.433037 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.458000 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ce91fdb-f9d4-529e-8715-29775a2007ca-da82e365-d8f6-432c-8d68-9fd1f25319ca', 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'fixed_ips': [{'subnet_id': '448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4'}]}} from dv-cinder-799668-16-iscsi. {{(pid=93837) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 01 17:03:36.459111 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.577835 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device bc0c4eb8-de3a-41c7-8977-ea220855327a up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:36.639300 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 72467e76-4867-467f-bdb2-3d1d360cfd19 up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:36.687346 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-dbd8dea5-6cfb-4eb6-b476-a961f3b50378 req-ba5191ee-b298-414b-afab-9859d9c801dc tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.699701 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.db_base_plugin_common [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Allocated IP 172.20.0.2 (da82e365-d8f6-432c-8d68-9fd1f25319ca/448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4/19061490-6b80-4580-a739-1b04aea7545c) {{(pid=93837) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:03:36.723451 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port bc0c4eb8-de3a-41c7-8977-ea220855327a completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:36.730095 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port bc0c4eb8-de3a-41c7-8977-ea220855327a triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:36.730669 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.733534 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba5191ee-b298-414b-afab-9859d9c801dc tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Pushing event deleted for resources: {'Port': ['ID=efd56e04-713d-49e6-9f93-b6c33f23c45b,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:36.765949 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Notify callbacks [] for port, precommit_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.779010 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.provisioning_blocks [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Transition to ACTIVE for port object b3f5695a-1b76-4688-983b-02a2efc00c3e will not be triggered until provisioned by entity L2. {{(pid=93838) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:36.787318 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.807643 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port 72467e76-4867-467f-bdb2-3d1d360cfd19 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:36.833262 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port 72467e76-4867-467f-bdb2-3d1d360cfd19 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:36.833792 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.844649 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-dbd8dea5-6cfb-4eb6-b476-a961f3b50378 req-ba5191ee-b298-414b-afab-9859d9c801dc tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] No DVR routers for this DVR port efd56e04-713d-49e6-9f93-b6c33f23c45b on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:03:36.854905 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-dbd8dea5-6cfb-4eb6-b476-a961f3b50378 req-ba5191ee-b298-414b-afab-9859d9c801dc tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.857364 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-dbd8dea5-6cfb-4eb6-b476-a961f3b50378 req-ba5191ee-b298-414b-afab-9859d9c801dc tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.69 "DELETE /v2.0/ports/efd56e04-713d-49e6-9f93-b6c33f23c45b HTTP/1.1" status: 204 len: 173 time: 0.7245414 Sep 01 17:03:36.857854 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c57e6fc1-fdb1-405e-9693-6d002580586e', 'name': 'network-vif-deleted', 'tag': 'efd56e04-713d-49e6-9f93-b6c33f23c45b'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:36.872358 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c49cf6ac-6a17-4909-830d-4036a0e54bf6" -d '{"events": [{"server_uuid": "c57e6fc1-fdb1-405e-9693-6d002580586e", "name": "network-vif-deleted", "tag": "efd56e04-713d-49e6-9f93-b6c33f23c45b"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:36.880103 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25ec2656-bb21-43c1-83b8-4306da4734e5 None None] Pushing event updated for resources: {'Port': ['ID=b3f5695a-1b76-4688-983b-02a2efc00c3e,revision_number=3']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:36.906735 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25ec2656-bb21-43c1-83b8-4306da4734e5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.907158 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25ec2656-bb21-43c1-83b8-4306da4734e5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.908198 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25ec2656-bb21-43c1-83b8-4306da4734e5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.908315 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25ec2656-bb21-43c1-83b8-4306da4734e5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.908941 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25ec2656-bb21-43c1-83b8-4306da4734e5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.909349 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25ec2656-bb21-43c1-83b8-4306da4734e5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.909867 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25ec2656-bb21-43c1-83b8-4306da4734e5 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.910345 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25ec2656-bb21-43c1-83b8-4306da4734e5 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.911129 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25ec2656-bb21-43c1-83b8-4306da4734e5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.911129 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25ec2656-bb21-43c1-83b8-4306da4734e5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.911355 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25ec2656-bb21-43c1-83b8-4306da4734e5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.911585 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25ec2656-bb21-43c1-83b8-4306da4734e5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:03:36.936012 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Attempting to bind port b3f5695a-1b76-4688-983b-02a2efc00c3e on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:03:36.937859 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Attempting to bind port b3f5695a-1b76-4688-983b-02a2efc00c3e by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '7629b231-1a75-4951-b23d-eecb3ccb3fd6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f'}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:03:36.938430 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Attempting to bind port b3f5695a-1b76-4688-983b-02a2efc00c3e on network e985feb4-0a78-4f0e-ad7c-52a73023bf6f {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:03:36.947224 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 3, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:03:36.947900 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Checking segment: {'id': '7629b231-1a75-4951-b23d-eecb3ccb3fd6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93838) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:03:36.948496 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.949717 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Bound using segment: {'id': '7629b231-1a75-4951-b23d-eecb3ccb3fd6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f'} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:03:36.950425 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Bound port: b3f5695a-1b76-4688-983b-02a2efc00c3e, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7629b231-1a75-4951-b23d-eecb3ccb3fd6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f'}}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:03:36.951001 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:36.981745 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4a56f803-f59b-42c6-a6b6-ad6d33ab8240 x-openstack-request-id: req-4a56f803-f59b-42c6-a6b6-ad6d33ab8240 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:36.982064 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c57e6fc1-fdb1-405e-9693-6d002580586e", "name": "network-vif-deleted", "tag": "efd56e04-713d-49e6-9f93-b6c33f23c45b", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:36.982311 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-4a56f803-f59b-42c6-a6b6-ad6d33ab8240 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:36.982741 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c57e6fc1-fdb1-405e-9693-6d002580586e', 'name': 'network-vif-deleted', 'tag': 'efd56e04-713d-49e6-9f93-b6c33f23c45b', 'status': 'completed', 'code': 200} Sep 01 17:03:37.034769 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.038867 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.060664 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-41038082-0035-4def-b67d-60e44a931f93 None None] For port b3f5695a-1b76-4688-983b-02a2efc00c3e, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93838) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:03:37.065438 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-41038082-0035-4def-b67d-60e44a931f93 None None] For port b3f5695a-1b76-4688-983b-02a2efc00c3e, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=b3f5695a-1b76-4688-983b-02a2efc00c3e,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93838) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:03:37.067966 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-06d13bfb-fe30-4308-91e0-73404604c5eb req-39b7d6aa-1dfd-4eed-86df-e320afc95879 tempest-VolumesSnapshotTestJSON-57022094 tempest-VolumesSnapshotTestJSON-57022094-project] 10.222.0.67 "GET /v2.0/ports?device_id=c57e6fc1-fdb1-405e-9693-6d002580586e HTTP/1.1" status: 200 len: 210 time: 0.1512637 Sep 01 17:03:37.076406 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.109677 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port bc0c4eb8-de3a-41c7-8977-ea220855327a, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=bc0c4eb8-de3a-41c7-8977-ea220855327a,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:37.150623 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Routers {'88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:37.151615 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-41038082-0035-4def-b67d-60e44a931f93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:03:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:37.153442 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25ec2656-bb21-43c1-83b8-4306da4734e5 None None] Pushing event updated for resources: {'Port': ['ID=b3f5695a-1b76-4688-983b-02a2efc00c3e,revision_number=4']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:37.164620 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.236235 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.257884 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Notify callbacks [] for port, precommit_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.287417 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Transition to ACTIVE for port object 19061490-6b80-4580-a739-1b04aea7545c will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:37.305194 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-41038082-0035-4def-b67d-60e44a931f93 None None] Set router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:37.330627 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c9dda17-56fd-454e-971d-8971bacf4d44', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '72467e76-4867-467f-bdb2-3d1d360cfd19'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:37.333178 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7102d5c0-2b1c-406b-8bd8-d18b41019a87" -d '{"events": [{"server_uuid": "1c9dda17-56fd-454e-971d-8971bacf4d44", "name": "network-vif-plugged", "status": "completed", "tag": "72467e76-4867-467f-bdb2-3d1d360cfd19"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:37.345818 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Transition to ACTIVE for port object 19061490-6b80-4580-a739-1b04aea7545c will not be triggered until provisioned by entity DHCP. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:37.364917 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 72467e76-4867-467f-bdb2-3d1d360cfd19, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=72467e76-4867-467f-bdb2-3d1d360cfd19,segment=NetworkSegment(b4bbb67e-00c9-4060-91ed-752e106d3acb),segment_id=b4bbb67e-00c9-4060-91ed-752e106d3acb)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:37.366238 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=bc0c4eb8-de3a-41c7-8977-ea220855327a,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:37.378239 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.388716 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.389788 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device efd56e04-713d-49e6-9f93-b6c33f23c45b no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:03:37.391672 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.417300 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-59ec9cbb-d22c-4113-9fef-c2a251458879 x-openstack-request-id: req-59ec9cbb-d22c-4113-9fef-c2a251458879 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:37.417942 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c9dda17-56fd-454e-971d-8971bacf4d44", "name": "network-vif-plugged", "status": "completed", "tag": "72467e76-4867-467f-bdb2-3d1d360cfd19", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:37.418378 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-59ec9cbb-d22c-4113-9fef-c2a251458879 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:37.418906 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c9dda17-56fd-454e-971d-8971bacf4d44', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '72467e76-4867-467f-bdb2-3d1d360cfd19', 'code': 200} Sep 01 17:03:37.433361 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.456351 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dafac78-1d69-478e-a520-b5275be67c4f req-c90792b9-5ad5-4f66-a83a-6bc6fe04f8b9 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:37.457956 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9dafac78-1d69-478e-a520-b5275be67c4f req-c90792b9-5ad5-4f66-a83a-6bc6fe04f8b9 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 944 time: 0.1763096 Sep 01 17:03:37.462402 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: efd56e04-713d-49e6-9f93-b6c33f23c45b {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:03:37.462943 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device efd56e04-713d-49e6-9f93-b6c33f23c45b not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:03:37.467355 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Network da82e365-d8f6-432c-8d68-9fd1f25319ca is already hosted by enough agents. {{(pid=93837) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:03:37.473217 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.base_scheduler [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Resources bound (agent type, host, resource id): {{(pid=93837) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:37.478690 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Received port after_create {{(pid=93837) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:03:37.483301 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Pushing event updated for resources: {'Port': ['ID=19061490-6b80-4580-a739-1b04aea7545c,revision_number=1']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:37.580809 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=72467e76-4867-467f-bdb2-3d1d360cfd19,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:37.583682 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Attempting to bind port 19061490-6b80-4580-a739-1b04aea7545c on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:03:37.584056 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Attempting to bind port 19061490-6b80-4580-a739-1b04aea7545c by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '125e7130-5134-4c18-b009-f88603063dcb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:03:37.584482 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Attempting to bind port 19061490-6b80-4580-a739-1b04aea7545c on network da82e365-d8f6-432c-8d68-9fd1f25319ca {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:03:37.589843 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 3, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:03:37.590305 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Checking segment: {'id': '125e7130-5134-4c18-b009-f88603063dcb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:03:37.590595 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.590974 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Bound using segment: {'id': '125e7130-5134-4c18-b009-f88603063dcb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:03:37.591432 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Bound port: 19061490-6b80-4580-a739-1b04aea7545c, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '125e7130-5134-4c18-b009-f88603063dcb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:03:37.591806 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.601021 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9dafac78-1d69-478e-a520-b5275be67c4f req-45182113-9051-40cf-993c-04fb85ac7348 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0842516 Sep 01 17:03:37.631631 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Allocated IP 172.27.1.48 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/124ce734-80f9-49e1-8136-5c2cba80df02) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:03:37.666870 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60be7af6-c6c8-4d53-9170-6b51ab2a5685 req-ed80f771-3817-4c57-aefb-8a03385c625e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:37.668627 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60be7af6-c6c8-4d53-9170-6b51ab2a5685 req-ed80f771-3817-4c57-aefb-8a03385c625e service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 1098 time: 0.0800443 Sep 01 17:03:37.686960 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-41038082-0035-4def-b67d-60e44a931f93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75'}], 'enable_snat': True}, 'gw_port_id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:34Z', 'revision_number': 4, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port': {'id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:f8:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'b3f5695a-1b76-4688-983b-02a2efc00c3e', 'name': '', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'tenant_id': '59475fb517464851810daf1967046d0c', 'mac_address': 'fa:16:3e:1b:db:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 603, 'fixed_ips': [{'subnet_id': '53347cb0-0e42-4047-9ec0-95b809608613', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:33Z', 'updated_at': '2021-09-01T17:03:37Z', 'revision_number': 4, 'project_id': '59475fb517464851810daf1967046d0c', 'subnets': [{'id': '53347cb0-0e42-4047-9ec0-95b809608613', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:37.716000 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41038082-0035-4def-b67d-60e44a931f93 None None] The sync data for ids ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'] in dv-cinder-799668-16-iscsi is: [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75'}], 'enable_snat': True}, 'gw_port_id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:34Z', 'revision_number': 4, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port': {'id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:f8:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'b3f5695a-1b76-4688-983b-02a2efc00c3e', 'name': '', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'tenant_id': '59475fb517464851810daf1967046d0c', 'mac_address': 'fa:16:3e:1b:db:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 603, 'fixed_ips': [{'subnet_id': '53347cb0-0e42-4047-9ec0-95b809608613', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:33Z', 'updated_at': '2021-09-01T17:03:37Z', 'revision_number': 4, 'project_id': '59475fb517464851810daf1967046d0c', 'subnets': [{'id': '53347cb0-0e42-4047-9ec0-95b809608613', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:03:37.727472 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-60be7af6-c6c8-4d53-9170-6b51ab2a5685 req-3514a702-ee54-40b7-b9b7-349f05ff7380 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512562 Sep 01 17:03:37.753922 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.813216 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] For port 19061490-6b80-4580-a739-1b04aea7545c, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:03:37.816960 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] For port 19061490-6b80-4580-a739-1b04aea7545c, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=19061490-6b80-4580-a739-1b04aea7545c,segment=NetworkSegment(125e7130-5134-4c18-b009-f88603063dcb),segment_id=125e7130-5134-4c18-b009-f88603063dcb)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:03:37.817354 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.826894 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:37.863872 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:03:37.869028 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:37.872793 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:03:37.891221 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66e687ca-15fc-4acf-9fdd-328aff39572d None None] Pushing event updated for resources: {'Port': ['ID=19061490-6b80-4580-a739-1b04aea7545c,revision_number=2']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:37.904318 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Pushing event updated for resources: {'Port': ['ID=124ce734-80f9-49e1-8136-5c2cba80df02,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:38.188994 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:38.427000 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1833934', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1833207'] for router, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:38.604110 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Router 79abe9a2-b31c-4365-9aa2-847054f5a3ff is scheduled to L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c with binding_index 1 {{(pid=93836) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 01 17:03:38.675713 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device b3f5695a-1b76-4688-983b-02a2efc00c3e up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:38.760659 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port b3f5695a-1b76-4688-983b-02a2efc00c3e completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:38.766493 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port b3f5695a-1b76-4688-983b-02a2efc00c3e triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:38.766945 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:38.769675 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:03:38.806560 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Sync routers for ids ['79abe9a2-b31c-4365-9aa2-847054f5a3ff'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:03:38.834166 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] Notify callbacks [] for router, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:38.835466 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-95d38638-bb2a-4a4a-a0ad-0149f16e8008 admin admin] 10.222.0.67 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 2.5698183 Sep 01 17:03:38.839140 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59298) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:38.842633 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Routers {'79abe9a2-b31c-4365-9aa2-847054f5a3ff'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:38.843828 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:03:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['79abe9a2-b31c-4365-9aa2-847054f5a3ff'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:38.866713 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6dad75a-ff98-49b4-aeb4-18f0e881043f req-1016c26a-20e5-43b1-af37-aa29c6a87b29 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:38.868309 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d6dad75a-ff98-49b4-aeb4-18f0e881043f req-1016c26a-20e5-43b1-af37-aa29c6a87b29 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 945 time: 0.1096175 Sep 01 17:03:38.929165 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d6dad75a-ff98-49b4-aeb4-18f0e881043f req-c7a113ca-e46a-4c86-a8ac-d78a1caef97e tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538318 Sep 01 17:03:39.011312 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:39.043314 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Set router 79abe9a2-b31c-4365-9aa2-847054f5a3ff gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:39.107848 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac0ec100-b80e-45d8-88b5-d42daac7ae37 None None] Network da82e365-d8f6-432c-8d68-9fd1f25319ca requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:03:39.143375 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port b3f5695a-1b76-4688-983b-02a2efc00c3e, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=b3f5695a-1b76-4688-983b-02a2efc00c3e,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:39.200338 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:39.201024 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 19061490-6b80-4580-a739-1b04aea7545c up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:39.263636 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-c787a379-97e6-4d2d-b2a6-ecd526f1bc19 None None] Provisioning for port 19061490-6b80-4580-a739-1b04aea7545c completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:39.334145 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=b3f5695a-1b76-4688-983b-02a2efc00c3e,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:39.372438 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:39.402646 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 19061490-6b80-4580-a739-1b04aea7545c completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:39.411312 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 19061490-6b80-4580-a739-1b04aea7545c triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:39.411675 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:39.503468 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'name': 'tempest-TestShelveInstance-531980329-router', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.48'}], 'enable_snat': True}, 'gw_port_id': '124ce734-80f9-49e1-8136-5c2cba80df02', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:36Z', 'updated_at': '2021-09-01T17:03:38Z', 'revision_number': 3, 'project_id': 'a7a2f1ded52e47fbabc7384bca188240', 'gw_port': {'id': '124ce734-80f9-49e1-8136-5c2cba80df02', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:6b:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 614, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:37Z', 'updated_at': '2021-09-01T17:03:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:39.546962 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Allocated IP 172.20.0.1 (da82e365-d8f6-432c-8d68-9fd1f25319ca/448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4/a1877e10-60db-47f0-adb3-2ad8f3753b36) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:03:39.553106 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Checking router: 79abe9a2-b31c-4365-9aa2-847054f5a3ff for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:03:39.553485 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Updating router 79abe9a2-b31c-4365-9aa2-847054f5a3ff port 124ce734-80f9-49e1-8136-5c2cba80df02 binding host dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 17:03:39.585445 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:39.587445 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:39.689027 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:39.697421 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port 19061490-6b80-4580-a739-1b04aea7545c, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=19061490-6b80-4580-a739-1b04aea7545c,segment=NetworkSegment(125e7130-5134-4c18-b009-f88603063dcb),segment_id=125e7130-5134-4c18-b009-f88603063dcb)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:39.704015 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:39.704913 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device bc0c4eb8-de3a-41c7-8977-ea220855327a up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:39.707419 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Transition to ACTIVE for port object a1877e10-60db-47f0-adb3-2ad8f3753b36 will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:39.757917 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:39.806289 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Network da82e365-d8f6-432c-8d68-9fd1f25319ca is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:03:39.811485 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:39.821735 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Pushing event updated for resources: {'Port': ['ID=a1877e10-60db-47f0-adb3-2ad8f3753b36,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:39.825303 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:03:39.852310 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=19061490-6b80-4580-a739-1b04aea7545c,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:39.865539 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1827972'] for router_interface, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:39.871490 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-e04116db-67e6-4eea-8834-e7a81ddd589f None None] Provisioning complete for port 19061490-6b80-4580-a739-1b04aea7545c triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:39.871935 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-e04116db-67e6-4eea-8834-e7a81ddd589f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:39.912816 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port bc0c4eb8-de3a-41c7-8977-ea220855327a triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:39.913156 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:40.015364 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:40.087420 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Notify callbacks [] for port, precommit_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:40.102248 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cde8e9c2-1a62-4793-9774-af4fcb32b046 req-c55e4492-43b5-4e2c-af18-c41e42e3d323 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:40.103892 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cde8e9c2-1a62-4793-9774-af4fcb32b046 req-c55e4492-43b5-4e2c-af18-c41e42e3d323 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 945 time: 0.0630093 Sep 01 17:03:40.114526 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Transition to ACTIVE for port object 124ce734-80f9-49e1-8136-5c2cba80df02 will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:40.124772 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:40.149057 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cde8e9c2-1a62-4793-9774-af4fcb32b046 req-2e626897-f52f-493a-9148-91778105da7d tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366395 Sep 01 17:03:40.180918 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Attempting to bind port 124ce734-80f9-49e1-8136-5c2cba80df02 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:03:40.181430 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Attempting to bind port 124ce734-80f9-49e1-8136-5c2cba80df02 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:03:40.181663 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Attempting to bind port 124ce734-80f9-49e1-8136-5c2cba80df02 on network e28b8145-06a4-43a8-a9f2-9a7014f96a23 {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:03:40.183692 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16cc7576-de2a-4fad-a01e-f3d348c4fb8e None None] Pushing event updated for resources: {'Port': ['ID=124ce734-80f9-49e1-8136-5c2cba80df02,revision_number=2']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:40.190013 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 3, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:03:40.190388 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Checking segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:03:40.190790 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:40.191162 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Bound using segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:03:40.191629 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Bound port: 124ce734-80f9-49e1-8136-5c2cba80df02, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:03:40.192009 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:40.216541 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:40.222057 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:40.254014 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] For port 124ce734-80f9-49e1-8136-5c2cba80df02, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:03:40.257308 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] For port 124ce734-80f9-49e1-8136-5c2cba80df02, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=124ce734-80f9-49e1-8136-5c2cba80df02,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:03:40.258816 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-0c60c838-c0dc-4b3e-9783-2b43d7dab2ca None None] Provisioning for port a1877e10-60db-47f0-adb3-2ad8f3753b36 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:40.263092 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:40.266237 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-0c60c838-c0dc-4b3e-9783-2b43d7dab2ca None None] Provisioning complete for port a1877e10-60db-47f0-adb3-2ad8f3753b36 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:40.267542 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-0c60c838-c0dc-4b3e-9783-2b43d7dab2ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:40.293063 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611336', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1832500'] for router_interface, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:40.300936 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Pushing event updated for resources: {'Port': ['ID=a1877e10-60db-47f0-adb3-2ad8f3753b36,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:40.345649 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-0c60c838-c0dc-4b3e-9783-2b43d7dab2ca None None] Port a1877e10-60db-47f0-adb3-2ad8f3753b36 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:03:40.350806 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Routers {'79abe9a2-b31c-4365-9aa2-847054f5a3ff'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:40.351422 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:03:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['79abe9a2-b31c-4365-9aa2-847054f5a3ff'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:40.354354 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16cc7576-de2a-4fad-a01e-f3d348c4fb8e None None] Pushing event updated for resources: {'Port': ['ID=124ce734-80f9-49e1-8136-5c2cba80df02,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:40.394202 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Network da82e365-d8f6-432c-8d68-9fd1f25319ca is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:03:40.396084 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:40.480236 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] Set router 79abe9a2-b31c-4365-9aa2-847054f5a3ff gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:40.512265 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 19061490-6b80-4580-a739-1b04aea7545c up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:40.728158 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-3396ce61-ec26-4ad7-8489-74fc58948f35 None None] Provisioning complete for port a1877e10-60db-47f0-adb3-2ad8f3753b36 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:40.728453 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-3396ce61-ec26-4ad7-8489-74fc58948f35 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:40.789735 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Router 79abe9a2-b31c-4365-9aa2-847054f5a3ff has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:03:40.811906 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-3396ce61-ec26-4ad7-8489-74fc58948f35 None None] Port a1877e10-60db-47f0-adb3-2ad8f3753b36 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:03:40.826428 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 19061490-6b80-4580-a739-1b04aea7545c triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:40.826793 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:40.913255 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:03:40.918899 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-a57664e7-a476-434e-b586-06dcbc4aa262 admin admin] 10.222.0.67 "PUT /v2.0/routers/79abe9a2-b31c-4365-9aa2-847054f5a3ff/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0780933 Sep 01 17:03:40.963514 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device b3f5695a-1b76-4688-983b-02a2efc00c3e up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:40.968089 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'name': 'tempest-TestShelveInstance-531980329-router', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.48'}], 'enable_snat': True}, 'gw_port_id': '124ce734-80f9-49e1-8136-5c2cba80df02', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:36Z', 'updated_at': '2021-09-01T17:03:39Z', 'revision_number': 4, 'project_id': 'a7a2f1ded52e47fbabc7384bca188240', 'gw_port': {'id': '124ce734-80f9-49e1-8136-5c2cba80df02', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:6b:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 614, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:37Z', 'updated_at': '2021-09-01T17:03:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'a1877e10-60db-47f0-adb3-2ad8f3753b36', 'name': '', 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'mac_address': 'fa:16:3e:eb:11:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'device_owner': 'network:router_interface', 'standard_attr_id': 615, 'fixed_ips': [{'subnet_id': '448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:39Z', 'updated_at': '2021-09-01T17:03:40Z', 'revision_number': 2, 'project_id': 'a7a2f1ded52e47fbabc7384bca188240', 'subnets': [{'id': '448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:41.015240 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-643af18c-0bfc-44d3-8a7e-0cd248710d68 None None] The sync data for ids ['79abe9a2-b31c-4365-9aa2-847054f5a3ff'] in dv-cinder-799668-16-iscsi is: [{'id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'name': 'tempest-TestShelveInstance-531980329-router', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.48'}], 'enable_snat': True}, 'gw_port_id': '124ce734-80f9-49e1-8136-5c2cba80df02', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:36Z', 'updated_at': '2021-09-01T17:03:39Z', 'revision_number': 4, 'project_id': 'a7a2f1ded52e47fbabc7384bca188240', 'gw_port': {'id': '124ce734-80f9-49e1-8136-5c2cba80df02', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:6b:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 614, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:37Z', 'updated_at': '2021-09-01T17:03:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'a1877e10-60db-47f0-adb3-2ad8f3753b36', 'name': '', 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'mac_address': 'fa:16:3e:eb:11:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'device_owner': 'network:router_interface', 'standard_attr_id': 615, 'fixed_ips': [{'subnet_id': '448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:39Z', 'updated_at': '2021-09-01T17:03:40Z', 'revision_number': 2, 'project_id': 'a7a2f1ded52e47fbabc7384bca188240', 'subnets': [{'id': '448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:03:41.045435 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port b3f5695a-1b76-4688-983b-02a2efc00c3e triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:41.046286 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:41.730965 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59324) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:41.737092 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-40f268ce-1f28-46c8-aed8-b66f738f8dae tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-79708857', 'description': 'tempest-secgroup-smoke-79708857 description', 'project_id': '59475fb517464851810daf1967046d0c'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:41.767417 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-40f268ce-1f28-46c8-aed8-b66f738f8dae tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:41.864069 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-40f268ce-1f28-46c8-aed8-b66f738f8dae tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:41.868300 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-40f268ce-1f28-46c8-aed8-b66f738f8dae tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:41.895217 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-40f268ce-1f28-46c8-aed8-b66f738f8dae tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:41.896448 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-40f268ce-1f28-46c8-aed8-b66f738f8dae tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1790 time: 0.1644826 Sep 01 17:03:41.899507 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59328) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:41.900399 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40f268ce-1f28-46c8-aed8-b66f738f8dae tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Pushing event updated for resources: {'SecurityGroup': ['ID=339064c2-239b-4c4c-877a-f7185ea53d6b,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:41.909173 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-9673a4a4-1f87-4d13-860a-014a6e9b49a5 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Request body: {'security_group_rule': {'security_group_id': '339064c2-239b-4c4c-877a-f7185ea53d6b', 'project_id': '59475fb517464851810daf1967046d0c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:41.943800 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9673a4a4-1f87-4d13-860a-014a6e9b49a5 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.000720 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9673a4a4-1f87-4d13-860a-014a6e9b49a5 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.005987 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9673a4a4-1f87-4d13-860a-014a6e9b49a5 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.023985 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9673a4a4-1f87-4d13-860a-014a6e9b49a5 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=790aed48-a8c5-4ea1-93c2-28a0a9d960db,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:42.031010 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9673a4a4-1f87-4d13-860a-014a6e9b49a5 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.032248 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-9673a4a4-1f87-4d13-860a-014a6e9b49a5 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1314776 Sep 01 17:03:42.035536 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59330) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:42.040442 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-eb19bbc4-f07c-40b3-a13b-518d69f64426 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Request body: {'security_group_rule': {'security_group_id': '339064c2-239b-4c4c-877a-f7185ea53d6b', 'project_id': '59475fb517464851810daf1967046d0c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:42.067494 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-eb19bbc4-f07c-40b3-a13b-518d69f64426 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.129190 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-eb19bbc4-f07c-40b3-a13b-518d69f64426 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.133093 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-eb19bbc4-f07c-40b3-a13b-518d69f64426 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.156355 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb19bbc4-f07c-40b3-a13b-518d69f64426 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=250e306f-49cd-47a5-ace0-1bf82352a02a,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:42.162111 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-eb19bbc4-f07c-40b3-a13b-518d69f64426 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.163335 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-eb19bbc4-f07c-40b3-a13b-518d69f64426 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1266017 Sep 01 17:03:42.166079 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59332) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:42.170518 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-05182205-a255-4b09-9255-c693bcede715 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Request body: {'security_group_rule': {'security_group_id': '339064c2-239b-4c4c-877a-f7185ea53d6b', 'project_id': '59475fb517464851810daf1967046d0c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:42.197788 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-05182205-a255-4b09-9255-c693bcede715 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.261688 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-05182205-a255-4b09-9255-c693bcede715 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.265347 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-05182205-a255-4b09-9255-c693bcede715 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.283601 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05182205-a255-4b09-9255-c693bcede715 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3ba19406-70f0-4a6d-8d8d-80e84bee1a61,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:42.289581 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-05182205-a255-4b09-9255-c693bcede715 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.290822 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-05182205-a255-4b09-9255-c693bcede715 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1236994 Sep 01 17:03:42.293467 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59334) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:42.298654 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-e1e7be2a-9ed9-4fb2-b05e-fc1a4c3c6e01 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Request body: {'security_group_rule': {'security_group_id': '339064c2-239b-4c4c-877a-f7185ea53d6b', 'project_id': '59475fb517464851810daf1967046d0c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:42.326926 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e1e7be2a-9ed9-4fb2-b05e-fc1a4c3c6e01 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.385683 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e1e7be2a-9ed9-4fb2-b05e-fc1a4c3c6e01 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.389346 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e1e7be2a-9ed9-4fb2-b05e-fc1a4c3c6e01 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.407110 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1e7be2a-9ed9-4fb2-b05e-fc1a4c3c6e01 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=27ccdcc3-f128-4226-bf0a-3f29a2d8437d,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:42.414191 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-e1e7be2a-9ed9-4fb2-b05e-fc1a4c3c6e01 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.418172 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-e1e7be2a-9ed9-4fb2-b05e-fc1a4c3c6e01 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1209538 Sep 01 17:03:42.418172 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59336) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:42.422418 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-00fe5cc2-23e0-4465-bcb3-e9be79d3b53e tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Request body: {'security_group_rule': {'security_group_id': '339064c2-239b-4c4c-877a-f7185ea53d6b', 'project_id': '59475fb517464851810daf1967046d0c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:42.447424 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.securitygroups_db [None req-00fe5cc2-23e0-4465-bcb3-e9be79d3b53e tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Project 59475fb517464851810daf1967046d0c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 01 17:03:42.453206 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-00fe5cc2-23e0-4465-bcb3-e9be79d3b53e tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.497652 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 124ce734-80f9-49e1-8136-5c2cba80df02 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:42.522188 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-00fe5cc2-23e0-4465-bcb3-e9be79d3b53e tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.527109 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-00fe5cc2-23e0-4465-bcb3-e9be79d3b53e tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.545725 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00fe5cc2-23e0-4465-bcb3-e9be79d3b53e tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7461c1f3-8195-41d6-a319-6eb59e8afe53,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:42.547765 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 124ce734-80f9-49e1-8136-5c2cba80df02 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:42.552886 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 124ce734-80f9-49e1-8136-5c2cba80df02 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:42.553068 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-00fe5cc2-23e0-4465-bcb3-e9be79d3b53e tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.553729 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.554233 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-00fe5cc2-23e0-4465-bcb3-e9be79d3b53e tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1352315 Sep 01 17:03:42.557054 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59338) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:03:42.561595 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-7da7c9cf-2f0e-4423-8985-cc5af5c2a52c tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Request body: {'security_group_rule': {'security_group_id': '339064c2-239b-4c4c-877a-f7185ea53d6b', 'project_id': '59475fb517464851810daf1967046d0c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:42.583460 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.securitygroups_db [None req-7da7c9cf-2f0e-4423-8985-cc5af5c2a52c tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Project 59475fb517464851810daf1967046d0c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 01 17:03:42.588567 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7da7c9cf-2f0e-4423-8985-cc5af5c2a52c tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.633450 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.655107 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port 124ce734-80f9-49e1-8136-5c2cba80df02, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=124ce734-80f9-49e1-8136-5c2cba80df02,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:42.658227 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7da7c9cf-2f0e-4423-8985-cc5af5c2a52c tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.661290 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.662349 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7da7c9cf-2f0e-4423-8985-cc5af5c2a52c tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.681150 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7da7c9cf-2f0e-4423-8985-cc5af5c2a52c tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=19bb2998-6998-47ea-a3c0-87bfc2aa7b3c,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:42.688570 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7da7c9cf-2f0e-4423-8985-cc5af5c2a52c tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:42.697974 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-7da7c9cf-2f0e-4423-8985-cc5af5c2a52c tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1321428 Sep 01 17:03:42.717661 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=124ce734-80f9-49e1-8136-5c2cba80df02,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:43.002571 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Sync routers for ids ['79abe9a2-b31c-4365-9aa2-847054f5a3ff'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:03:43.013126 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Routers {'79abe9a2-b31c-4365-9aa2-847054f5a3ff'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:43.013789 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:03:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['79abe9a2-b31c-4365-9aa2-847054f5a3ff'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:43.178058 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Set router 79abe9a2-b31c-4365-9aa2-847054f5a3ff gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:43.374441 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba521e44-1da2-49f9-b21f-3b814f8689a2 req-7575a55e-89d8-4de6-b1b1-3ba92769d38c tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:43.376934 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ba521e44-1da2-49f9-b21f-3b814f8689a2 req-7575a55e-89d8-4de6-b1b1-3ba92769d38c tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 945 time: 0.0687895 Sep 01 17:03:43.432586 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ba521e44-1da2-49f9-b21f-3b814f8689a2 req-32fbcba3-8415-48dd-bca0-1fbd28d117e9 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491498 Sep 01 17:03:43.554104 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'name': 'tempest-TestShelveInstance-531980329-router', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.48'}], 'enable_snat': True}, 'gw_port_id': '124ce734-80f9-49e1-8136-5c2cba80df02', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:36Z', 'updated_at': '2021-09-01T17:03:39Z', 'revision_number': 4, 'project_id': 'a7a2f1ded52e47fbabc7384bca188240', 'gw_port': {'id': '124ce734-80f9-49e1-8136-5c2cba80df02', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:6b:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 614, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:37Z', 'updated_at': '2021-09-01T17:03:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'a1877e10-60db-47f0-adb3-2ad8f3753b36', 'name': '', 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'mac_address': 'fa:16:3e:eb:11:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'device_owner': 'network:router_interface', 'standard_attr_id': 615, 'fixed_ips': [{'subnet_id': '448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:39Z', 'updated_at': '2021-09-01T17:03:40Z', 'revision_number': 2, 'project_id': 'a7a2f1ded52e47fbabc7384bca188240', 'subnets': [{'id': '448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:43.583993 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Checking router: 79abe9a2-b31c-4365-9aa2-847054f5a3ff for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:03:43.584345 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Updating router 79abe9a2-b31c-4365-9aa2-847054f5a3ff port a1877e10-60db-47f0-adb3-2ad8f3753b36 binding host dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 17:03:43.612444 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:43.896909 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Notify callbacks [] for port, precommit_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:43.906868 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.provisioning_blocks [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Transition to ACTIVE for port object a1877e10-60db-47f0-adb3-2ad8f3753b36 will not be triggered until provisioned by entity L2. {{(pid=93838) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:43.913056 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:43.980575 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2f228dd-237a-43ba-b2ea-1c4b7135c4cf None None] Pushing event updated for resources: {'Port': ['ID=a1877e10-60db-47f0-adb3-2ad8f3753b36,revision_number=3']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:44.018005 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Attempting to bind port a1877e10-60db-47f0-adb3-2ad8f3753b36 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:03:44.018655 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Attempting to bind port a1877e10-60db-47f0-adb3-2ad8f3753b36 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '125e7130-5134-4c18-b009-f88603063dcb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca'}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:03:44.018928 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Attempting to bind port a1877e10-60db-47f0-adb3-2ad8f3753b36 on network da82e365-d8f6-432c-8d68-9fd1f25319ca {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:03:44.024575 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 3, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:03:44.025044 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Checking segment: {'id': '125e7130-5134-4c18-b009-f88603063dcb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93838) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:03:44.025570 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:44.026269 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Bound using segment: {'id': '125e7130-5134-4c18-b009-f88603063dcb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca'} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:03:44.026804 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Bound port: a1877e10-60db-47f0-adb3-2ad8f3753b36, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '125e7130-5134-4c18-b009-f88603063dcb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 546, 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca'}}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:03:44.027259 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:44.092011 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] For port a1877e10-60db-47f0-adb3-2ad8f3753b36, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93838) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:03:44.095791 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] For port a1877e10-60db-47f0-adb3-2ad8f3753b36, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=a1877e10-60db-47f0-adb3-2ad8f3753b36,segment=NetworkSegment(125e7130-5134-4c18-b009-f88603063dcb),segment_id=125e7130-5134-4c18-b009-f88603063dcb)] {{(pid=93838) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:03:44.099434 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:44.167599 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Routers {'79abe9a2-b31c-4365-9aa2-847054f5a3ff'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:03:44.168232 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:03:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['79abe9a2-b31c-4365-9aa2-847054f5a3ff'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:44.170263 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2f228dd-237a-43ba-b2ea-1c4b7135c4cf None None] Pushing event updated for resources: {'Port': ['ID=a1877e10-60db-47f0-adb3-2ad8f3753b36,revision_number=4']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:44.281925 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] Set router 79abe9a2-b31c-4365-9aa2-847054f5a3ff gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:03:44.508168 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 124ce734-80f9-49e1-8136-5c2cba80df02 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:44.514910 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'name': 'tempest-TestShelveInstance-531980329-router', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.48'}], 'enable_snat': True}, 'gw_port_id': '124ce734-80f9-49e1-8136-5c2cba80df02', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:36Z', 'updated_at': '2021-09-01T17:03:39Z', 'revision_number': 4, 'project_id': 'a7a2f1ded52e47fbabc7384bca188240', 'gw_port': {'id': '124ce734-80f9-49e1-8136-5c2cba80df02', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:6b:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 614, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:37Z', 'updated_at': '2021-09-01T17:03:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'a1877e10-60db-47f0-adb3-2ad8f3753b36', 'name': '', 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'mac_address': 'fa:16:3e:eb:11:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'device_owner': 'network:router_interface', 'standard_attr_id': 615, 'fixed_ips': [{'subnet_id': '448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:39Z', 'updated_at': '2021-09-01T17:03:44Z', 'revision_number': 4, 'project_id': 'a7a2f1ded52e47fbabc7384bca188240', 'subnets': [{'id': '448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:03:44.543400 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d88326f-b6d7-43c3-abf4-4544b420975d None None] The sync data for ids ['79abe9a2-b31c-4365-9aa2-847054f5a3ff'] in dv-cinder-799668-16-iscsi is: [{'id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'name': 'tempest-TestShelveInstance-531980329-router', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.48'}], 'enable_snat': True}, 'gw_port_id': '124ce734-80f9-49e1-8136-5c2cba80df02', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:36Z', 'updated_at': '2021-09-01T17:03:39Z', 'revision_number': 4, 'project_id': 'a7a2f1ded52e47fbabc7384bca188240', 'gw_port': {'id': '124ce734-80f9-49e1-8136-5c2cba80df02', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:6b:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 614, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:37Z', 'updated_at': '2021-09-01T17:03:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'a1877e10-60db-47f0-adb3-2ad8f3753b36', 'name': '', 'network_id': 'da82e365-d8f6-432c-8d68-9fd1f25319ca', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'mac_address': 'fa:16:3e:eb:11:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'device_owner': 'network:router_interface', 'standard_attr_id': 615, 'fixed_ips': [{'subnet_id': '448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:39Z', 'updated_at': '2021-09-01T17:03:44Z', 'revision_number': 4, 'project_id': 'a7a2f1ded52e47fbabc7384bca188240', 'subnets': [{'id': '448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:03:44.566039 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 124ce734-80f9-49e1-8136-5c2cba80df02 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:44.566720 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:44.595475 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4b36ee-8e4c-407b-bd73-dfb309fa499d req-10c99258-913e-4a8d-9172-af911e5bd88e tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:44.597171 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-dc4b36ee-8e4c-407b-bd73-dfb309fa499d req-10c99258-913e-4a8d-9172-af911e5bd88e tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 945 time: 0.0733039 Sep 01 17:03:44.659301 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-dc4b36ee-8e4c-407b-bd73-dfb309fa499d req-786c2d6f-544e-44b6-9dbf-492c03e6c7a3 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475483 Sep 01 17:03:44.693471 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device a1877e10-60db-47f0-adb3-2ad8f3753b36 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:44.754248 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port a1877e10-60db-47f0-adb3-2ad8f3753b36 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:44.758357 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port a1877e10-60db-47f0-adb3-2ad8f3753b36 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:44.758798 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:44.844535 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:44.889528 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port a1877e10-60db-47f0-adb3-2ad8f3753b36, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=a1877e10-60db-47f0-adb3-2ad8f3753b36,segment=NetworkSegment(125e7130-5134-4c18-b009-f88603063dcb),segment_id=125e7130-5134-4c18-b009-f88603063dcb)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:44.895784 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:44.897324 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee462edc-a733-4023-b152-b2a2ffdfd5e9 req-23264fd0-822a-4b13-8bed-5254a56fc7f1 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:44.899271 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-ee462edc-a733-4023-b152-b2a2ffdfd5e9 req-23264fd0-822a-4b13-8bed-5254a56fc7f1 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.69 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 945 time: 0.0663817 Sep 01 17:03:44.971923 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=a1877e10-60db-47f0-adb3-2ad8f3753b36,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:45.017785 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-ee462edc-a733-4023-b152-b2a2ffdfd5e9 req-8b2fb0ab-8b15-4a13-90bf-204f1a2ae7ee tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Deleting port 72467e76-4867-467f-bdb2-3d1d360cfd19 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:03:45.017785 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-ee462edc-a733-4023-b152-b2a2ffdfd5e9 req-8b2fb0ab-8b15-4a13-90bf-204f1a2ae7ee tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:45.115008 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-ee462edc-a733-4023-b152-b2a2ffdfd5e9 req-8b2fb0ab-8b15-4a13-90bf-204f1a2ae7ee tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] For port 72467e76-4867-467f-bdb2-3d1d360cfd19, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=72467e76-4867-467f-bdb2-3d1d360cfd19,segment=NetworkSegment(b4bbb67e-00c9-4060-91ed-752e106d3acb),segment_id=b4bbb67e-00c9-4060-91ed-752e106d3acb)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:45.115376 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-ee462edc-a733-4023-b152-b2a2ffdfd5e9 req-8b2fb0ab-8b15-4a13-90bf-204f1a2ae7ee tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:45.130898 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-ee462edc-a733-4023-b152-b2a2ffdfd5e9 req-8b2fb0ab-8b15-4a13-90bf-204f1a2ae7ee tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Calling delete_port for 72467e76-4867-467f-bdb2-3d1d360cfd19 owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:03:45.270685 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-ee462edc-a733-4023-b152-b2a2ffdfd5e9 req-8b2fb0ab-8b15-4a13-90bf-204f1a2ae7ee tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:45.282345 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['72467e76-4867-467f-bdb2-3d1d360cfd19'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:03:45.300445 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b2fb0ab-8b15-4a13-90bf-204f1a2ae7ee tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Pushing event deleted for resources: {'Port': ['ID=72467e76-4867-467f-bdb2-3d1d360cfd19,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:45.343328 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-ee462edc-a733-4023-b152-b2a2ffdfd5e9 req-8b2fb0ab-8b15-4a13-90bf-204f1a2ae7ee tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] No DVR routers for this DVR port 72467e76-4867-467f-bdb2-3d1d360cfd19 on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:03:45.346066 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-ee462edc-a733-4023-b152-b2a2ffdfd5e9 req-8b2fb0ab-8b15-4a13-90bf-204f1a2ae7ee tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:45.348242 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-ee462edc-a733-4023-b152-b2a2ffdfd5e9 req-8b2fb0ab-8b15-4a13-90bf-204f1a2ae7ee tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.69 "DELETE /v2.0/ports/72467e76-4867-467f-bdb2-3d1d360cfd19 HTTP/1.1" status: 204 len: 173 time: 0.4412861 Sep 01 17:03:45.348677 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c9dda17-56fd-454e-971d-8971bacf4d44', 'name': 'network-vif-deleted', 'tag': '72467e76-4867-467f-bdb2-3d1d360cfd19'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:45.351016 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f3023720-b187-4a2c-ab4e-8e886599c627" -d '{"events": [{"server_uuid": "1c9dda17-56fd-454e-971d-8971bacf4d44", "name": "network-vif-deleted", "tag": "72467e76-4867-467f-bdb2-3d1d360cfd19"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:45.454082 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a5130a8e-82a1-4e97-9a90-a0a2ea48bdab x-openstack-request-id: req-a5130a8e-82a1-4e97-9a90-a0a2ea48bdab {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:45.454352 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c9dda17-56fd-454e-971d-8971bacf4d44", "name": "network-vif-deleted", "tag": "72467e76-4867-467f-bdb2-3d1d360cfd19", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:45.454601 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-a5130a8e-82a1-4e97-9a90-a0a2ea48bdab {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:45.455086 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c9dda17-56fd-454e-971d-8971bacf4d44', 'name': 'network-vif-deleted', 'tag': '72467e76-4867-467f-bdb2-3d1d360cfd19', 'status': 'completed', 'code': 200} Sep 01 17:03:45.768791 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9187117b-596f-4663-b26d-462528e4b91f req-1e6b99e1-0735-4a6e-83f3-40fcf4a895f7 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=1c9dda17-56fd-454e-971d-8971bacf4d44 HTTP/1.1" status: 200 len: 210 time: 0.0296571 Sep 01 17:03:46.475061 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device a1877e10-60db-47f0-adb3-2ad8f3753b36 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:46.520370 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port a1877e10-60db-47f0-adb3-2ad8f3753b36 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:46.520738 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:47.080794 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-963759e6-0b04-4961-9570-c5dfdb32ac65 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:47.082319 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-963759e6-0b04-4961-9570-c5dfdb32ac65 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/networks?id=42a712e0-c504-45f6-a772-96f7157e5bc3 HTTP/1.1" status: 200 len: 807 time: 0.1048665 Sep 01 17:03:47.098694 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-8e648ae1-2d6a-4782-b35b-1ead37db9a7c tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/quotas/0bbcb858ecfd4ebf8ddcdb3f0ee0ca35 HTTP/1.1" status: 200 len: 375 time: 0.0102234 Sep 01 17:03:47.132774 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-6f3f91a6-98da-40b9-ac39-2b71d243ae79 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=0bbcb858ecfd4ebf8ddcdb3f0ee0ca35&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0274317 Sep 01 17:03:47.330087 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-a77f04f6-c1d6-450c-bc1b-1e37e1644fe4 service neutron] 10.222.0.67 "GET /v2.0/networks/42a712e0-c504-45f6-a772-96f7157e5bc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1894991 Sep 01 17:03:47.419881 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-6082fa2c-b9ea-4729-b059-119eb10ba48d service neutron] 10.222.0.67 "GET /v2.0/networks/42a712e0-c504-45f6-a772-96f7157e5bc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818875 Sep 01 17:03:47.584863 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bc46b104-164f-47cd-bc1b-040237e27c3c req-1d5e8430-350b-4954-b574-dcec164158b5 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 210 time: 0.0286024 Sep 01 17:03:48.678407 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7a5df8b0-1e78-49c1-ad42-e83714920988 req-a2163692-d41e-44f4-84f8-8635fe4e8926 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 210 time: 0.0252142 Sep 01 17:03:49.665195 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 72467e76-4867-467f-bdb2-3d1d360cfd19 no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:03:49.684537 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: 72467e76-4867-467f-bdb2-3d1d360cfd19 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:03:49.684879 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 72467e76-4867-467f-bdb2-3d1d360cfd19 not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:03:49.778924 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-05656443-b295-41df-9920-e167876f3b00 req-c084aa39-35ef-4572-b2b3-118ee395b6bc tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 210 time: 0.0302880 Sep 01 17:03:50.875485 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1c4f8ccf-4288-4b27-b396-a1b8d09c8d7c req-b37ad290-7b97-4214-8229-2fef576c3144 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 210 time: 0.0282764 Sep 01 17:03:51.238759 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-a62f1147-89df-47b1-b320-78a230cfa747 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:51.349321 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-601ee987-cb80-4b08-90fc-657eb98fffca tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:51.351778 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-601ee987-cb80-4b08-90fc-657eb98fffca tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.69 "GET /v2.0/networks?id=42a712e0-c504-45f6-a772-96f7157e5bc3 HTTP/1.1" status: 200 len: 807 time: 0.1089797 Sep 01 17:03:51.366029 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-ceb8fff6-0867-4ad7-b8e1-d527e31bdfad tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Request body: {'port': {'device_id': '8c572a27-9061-4941-896a-9928a2c08fc0', 'network_id': '42a712e0-c504-45f6-a772-96f7157e5bc3', 'admin_state_up': True, 'tenant_id': '0bbcb858ecfd4ebf8ddcdb3f0ee0ca35'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:51.482938 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-ceb8fff6-0867-4ad7-b8e1-d527e31bdfad tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Made reservation on behalf of 0bbcb858ecfd4ebf8ddcdb3f0ee0ca35 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:03:51.487090 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-ceb8fff6-0867-4ad7-b8e1-d527e31bdfad tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:51.634133 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-ceb8fff6-0867-4ad7-b8e1-d527e31bdfad tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Allocated IP 172.20.0.12 (42a712e0-c504-45f6-a772-96f7157e5bc3/f7abf916-2e22-4954-874c-6d7775564f14/ed2f88db-dec4-4610-84e4-2cb90d02fbfd) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:03:51.819011 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-ceb8fff6-0867-4ad7-b8e1-d527e31bdfad tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:51.859685 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-ceb8fff6-0867-4ad7-b8e1-d527e31bdfad tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:51.902834 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-ceb8fff6-0867-4ad7-b8e1-d527e31bdfad tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Network 42a712e0-c504-45f6-a772-96f7157e5bc3 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:03:51.908623 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-ceb8fff6-0867-4ad7-b8e1-d527e31bdfad tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:03:51.911508 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-ceb8fff6-0867-4ad7-b8e1-d527e31bdfad tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:03:51.943406 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb8fff6-0867-4ad7-b8e1-d527e31bdfad tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Pushing event updated for resources: {'Port': ['ID=ed2f88db-dec4-4610-84e4-2cb90d02fbfd,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:51.970801 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-ceb8fff6-0867-4ad7-b8e1-d527e31bdfad tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:51.971437 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-ceb8fff6-0867-4ad7-b8e1-d527e31bdfad tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:51.989076 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-ceb8fff6-0867-4ad7-b8e1-d527e31bdfad tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6273227 Sep 01 17:03:51.993239 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6d490b3-4025-45ca-bb76-e69710178e8f req-545447f5-9fcc-44e4-9192-1551c965c6a6 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:51.994823 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f6d490b3-4025-45ca-bb76-e69710178e8f req-545447f5-9fcc-44e4-9192-1551c965c6a6 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 932 time: 0.0518594 Sep 01 17:03:52.006023 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Request body: {'port': {'device_id': '8c572a27-9061-4941-896a-9928a2c08fc0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:03:52.033641 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f6d490b3-4025-45ca-bb76-e69710178e8f req-819674a2-af65-4400-addd-506572d0dd35 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327582 Sep 01 17:03:52.065214 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:52.329477 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ed2f88db-dec4-4610-84e4-2cb90d02fbfd {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:03:52.338113 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:52.353815 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Transition to ACTIVE for port object ed2f88db-dec4-4610-84e4-2cb90d02fbfd will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:03:52.357750 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:52.406108 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Pushing event updated for resources: {'Port': ['ID=ed2f88db-dec4-4610-84e4-2cb90d02fbfd,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:52.478135 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Attempting to bind port ed2f88db-dec4-4610-84e4-2cb90d02fbfd on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:03:52.478480 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Attempting to bind port ed2f88db-dec4-4610-84e4-2cb90d02fbfd by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': 'b4bbb67e-00c9-4060-91ed-752e106d3acb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 516, 'network_id': '42a712e0-c504-45f6-a772-96f7157e5bc3'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:03:52.478817 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Attempting to bind port ed2f88db-dec4-4610-84e4-2cb90d02fbfd on network 42a712e0-c504-45f6-a772-96f7157e5bc3 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:03:52.483042 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Port ed2f88db-dec4-4610-84e4-2cb90d02fbfd on network 42a712e0-c504-45f6-a772-96f7157e5bc3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:03:52.483378 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Attempting to bind port ed2f88db-dec4-4610-84e4-2cb90d02fbfd on network 42a712e0-c504-45f6-a772-96f7157e5bc3 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:03:52.488842 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 3, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:03:52.489187 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Checking segment: {'id': 'b4bbb67e-00c9-4060-91ed-752e106d3acb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 516, 'network_id': '42a712e0-c504-45f6-a772-96f7157e5bc3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:03:52.489614 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Bound using segment: {'id': 'b4bbb67e-00c9-4060-91ed-752e106d3acb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 516, 'network_id': '42a712e0-c504-45f6-a772-96f7157e5bc3'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:03:52.490049 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Bound port: ed2f88db-dec4-4610-84e4-2cb90d02fbfd, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b4bbb67e-00c9-4060-91ed-752e106d3acb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 516, 'network_id': '42a712e0-c504-45f6-a772-96f7157e5bc3'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:03:52.490412 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:52.555206 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] For port ed2f88db-dec4-4610-84e4-2cb90d02fbfd, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:03:52.558201 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] For port ed2f88db-dec4-4610-84e4-2cb90d02fbfd, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=ed2f88db-dec4-4610-84e4-2cb90d02fbfd,segment=NetworkSegment(b4bbb67e-00c9-4060-91ed-752e106d3acb),segment_id=b4bbb67e-00c9-4060-91ed-752e106d3acb)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:03:52.562460 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:52.596381 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:52.596994 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:52.598402 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] 10.222.0.69 "PUT /v2.0/ports/ed2f88db-dec4-4610-84e4-2cb90d02fbfd HTTP/1.1" status: 200 len: 1094 time: 0.5975022 Sep 01 17:03:52.598836 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8c572a27-9061-4941-896a-9928a2c08fc0', 'tag': 'ed2f88db-dec4-4610-84e4-2cb90d02fbfd'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:52.601056 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-07129f32-d2f7-429c-a94c-160fb599cf28" -d '{"events": [{"name": "network-changed", "server_uuid": "8c572a27-9061-4941-896a-9928a2c08fc0", "tag": "ed2f88db-dec4-4610-84e4-2cb90d02fbfd"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:52.625082 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7d6e350-c0e7-496e-8440-c8f69d27b869 service neutron] Pushing event updated for resources: {'Port': ['ID=ed2f88db-dec4-4610-84e4-2cb90d02fbfd,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:52.645802 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-abbadf2a-fa43-4797-8197-f17ef43ed118 x-openstack-request-id: req-abbadf2a-fa43-4797-8197-f17ef43ed118 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:52.646089 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8c572a27-9061-4941-896a-9928a2c08fc0", "tag": "ed2f88db-dec4-4610-84e4-2cb90d02fbfd", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:52.646346 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-abbadf2a-fa43-4797-8197-f17ef43ed118 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:52.646733 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8c572a27-9061-4941-896a-9928a2c08fc0', 'tag': 'ed2f88db-dec4-4610-84e4-2cb90d02fbfd', 'status': 'completed', 'code': 200} Sep 01 17:03:52.680367 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-0ec4d53d-7a12-4f84-8a7d-421ab24cd86b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:52.681991 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-0ec4d53d-7a12-4f84-8a7d-421ab24cd86b service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0bbcb858ecfd4ebf8ddcdb3f0ee0ca35&device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 1097 time: 0.0461769 Sep 01 17:03:52.732771 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-9e1ba6e2-81fe-43e0-b282-fb05acacdfa9 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ed2f88db-dec4-4610-84e4-2cb90d02fbfd HTTP/1.1" status: 200 len: 217 time: 0.0404844 Sep 01 17:03:52.785170 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-94184b7f-29c1-4f73-b4c2-d16c5bdad22f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:52.786712 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-94184b7f-29c1-4f73-b4c2-d16c5bdad22f service neutron] 10.222.0.69 "GET /v2.0/subnets?id=f7abf916-2e22-4954-874c-6d7775564f14 HTTP/1.1" status: 200 len: 847 time: 0.0466406 Sep 01 17:03:52.822324 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-fb9091d0-277e-404d-b4d9-62d86b8277ca service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=42a712e0-c504-45f6-a772-96f7157e5bc3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0272830 Sep 01 17:03:52.925710 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-3e0d01f8-8396-47bb-ba61-4c1ec86cf2de service neutron] 10.222.0.69 "GET /v2.0/networks/42a712e0-c504-45f6-a772-96f7157e5bc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0947967 Sep 01 17:03:53.023318 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a2c90367-d665-4bcf-b5b4-b89a747c7bc0 req-2725692f-8af2-48a0-92a2-8634c7a33e9d service neutron] 10.222.0.69 "GET /v2.0/networks/42a712e0-c504-45f6-a772-96f7157e5bc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0892806 Sep 01 17:03:53.113494 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07129f32-d2f7-429c-a94c-160fb599cf28 req-3f8646d0-f48f-40e3-ac58-7f2442ff3a58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:53.114983 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-07129f32-d2f7-429c-a94c-160fb599cf28 req-3f8646d0-f48f-40e3-ac58-7f2442ff3a58 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=0bbcb858ecfd4ebf8ddcdb3f0ee0ca35&device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 1097 time: 0.0436058 Sep 01 17:03:53.160298 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f12d39a-155b-4ff6-a399-49f5358a72dc req-46d1eb31-c46c-4b94-9f2d-b04aed3fc310 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:53.162443 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0f12d39a-155b-4ff6-a399-49f5358a72dc req-46d1eb31-c46c-4b94-9f2d-b04aed3fc310 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 944 time: 0.0553277 Sep 01 17:03:53.201365 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0f12d39a-155b-4ff6-a399-49f5358a72dc req-0f2c28f7-efaa-40ef-a4b4-33f8f6078816 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326562 Sep 01 17:03:53.219575 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07129f32-d2f7-429c-a94c-160fb599cf28 req-923c20f3-eedf-4403-afad-5633ed2cc8d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:53.221136 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-07129f32-d2f7-429c-a94c-160fb599cf28 req-923c20f3-eedf-4403-afad-5633ed2cc8d5 service neutron] 10.222.0.69 "GET /v2.0/networks?id=42a712e0-c504-45f6-a772-96f7157e5bc3 HTTP/1.1" status: 200 len: 908 time: 0.0988173 Sep 01 17:03:53.264747 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-07129f32-d2f7-429c-a94c-160fb599cf28 req-8a581926-3de3-406c-bbed-a622e4796cbe service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ed2f88db-dec4-4610-84e4-2cb90d02fbfd HTTP/1.1" status: 200 len: 217 time: 0.0356879 Sep 01 17:03:53.316995 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07129f32-d2f7-429c-a94c-160fb599cf28 req-d03a3207-470b-49ac-8e86-d9e52852c436 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:53.318477 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-07129f32-d2f7-429c-a94c-160fb599cf28 req-d03a3207-470b-49ac-8e86-d9e52852c436 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=f7abf916-2e22-4954-874c-6d7775564f14 HTTP/1.1" status: 200 len: 847 time: 0.0466640 Sep 01 17:03:53.353754 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-07129f32-d2f7-429c-a94c-160fb599cf28 req-e1bcde05-c19c-4352-8d84-428b87cb7939 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=42a712e0-c504-45f6-a772-96f7157e5bc3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0279803 Sep 01 17:03:53.446480 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-07129f32-d2f7-429c-a94c-160fb599cf28 req-c44dd1da-fd74-4d03-8920-6de09ea6a0b7 service neutron] 10.222.0.69 "GET /v2.0/networks/42a712e0-c504-45f6-a772-96f7157e5bc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840595 Sep 01 17:03:53.541582 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-07129f32-d2f7-429c-a94c-160fb599cf28 req-e3ef79e5-a9a3-44e8-beeb-b4b8440edbca service neutron] 10.222.0.69 "GET /v2.0/networks/42a712e0-c504-45f6-a772-96f7157e5bc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870783 Sep 01 17:03:53.763775 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:53.774588 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-dc39f800-42e9-45b8-b0d3-28f5e1f1e598 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:54.325462 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b794176c-9213-4424-b727-6df405b7aa49 req-dd276688-b65c-4984-8c76-0489f9986b97 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:54.326867 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b794176c-9213-4424-b727-6df405b7aa49 req-dd276688-b65c-4984-8c76-0489f9986b97 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 944 time: 0.0551014 Sep 01 17:03:54.365758 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b794176c-9213-4424-b727-6df405b7aa49 req-835379e2-5bcf-4157-a9e7-eaf745e142f4 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328147 Sep 01 17:03:54.908903 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:54.964822 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device ed2f88db-dec4-4610-84e4-2cb90d02fbfd details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:03:55.061815 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port ed2f88db-dec4-4610-84e4-2cb90d02fbfd, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=ed2f88db-dec4-4610-84e4-2cb90d02fbfd,segment=NetworkSegment(b4bbb67e-00c9-4060-91ed-752e106d3acb),segment_id=b4bbb67e-00c9-4060-91ed-752e106d3acb)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:55.073721 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'ed2f88db-dec4-4610-84e4-2cb90d02fbfd', 'network_id': '42a712e0-c504-45f6-a772-96f7157e5bc3', 'port_id': 'ed2f88db-dec4-4610-84e4-2cb90d02fbfd', 'mac_address': 'fa:16:3e:7a:17:6b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 516, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f7abf916-2e22-4954-874c-6d7775564f14', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:03:55.110872 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:55.127431 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ed2f88db-dec4-4610-84e4-2cb90d02fbfd {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:03:55.153096 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port ed2f88db-dec4-4610-84e4-2cb90d02fbfd, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=ed2f88db-dec4-4610-84e4-2cb90d02fbfd,segment=NetworkSegment(b4bbb67e-00c9-4060-91ed-752e106d3acb),segment_id=b4bbb67e-00c9-4060-91ed-752e106d3acb)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:55.157576 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:55.212910 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=ed2f88db-dec4-4610-84e4-2cb90d02fbfd,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:55.430850 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['ed2f88db-dec4-4610-84e4-2cb90d02fbfd'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:03:55.492695 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac82762b-401f-4ab9-b751-1f617dbbddb5 req-b480e8ed-6cd5-42db-8425-387cd28ffa89 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:55.494249 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ac82762b-401f-4ab9-b751-1f617dbbddb5 req-b480e8ed-6cd5-42db-8425-387cd28ffa89 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 945 time: 0.0547833 Sep 01 17:03:55.533192 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ac82762b-401f-4ab9-b751-1f617dbbddb5 req-5c5c742e-510d-42c8-809b-c34a30433793 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325754 Sep 01 17:03:56.547835 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:56.579185 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:56.648996 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c45295a0-8077-4c37-814d-c3b76164a7fe req-ee9a75cb-4a91-4cbe-af58-d9f6e0d4c955 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:56.650633 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c45295a0-8077-4c37-814d-c3b76164a7fe req-ee9a75cb-4a91-4cbe-af58-d9f6e0d4c955 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 945 time: 0.0511861 Sep 01 17:03:56.692216 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c45295a0-8077-4c37-814d-c3b76164a7fe req-22a133c9-dcb5-4fb8-a377-f707b4d25443 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331132 Sep 01 17:03:56.987049 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device ed2f88db-dec4-4610-84e4-2cb90d02fbfd up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:03:57.033793 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port ed2f88db-dec4-4610-84e4-2cb90d02fbfd completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:03:57.037496 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port ed2f88db-dec4-4610-84e4-2cb90d02fbfd triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:03:57.037868 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:57.116509 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:57.138193 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8c572a27-9061-4941-896a-9928a2c08fc0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ed2f88db-dec4-4610-84e4-2cb90d02fbfd'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:03:57.140389 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e7fff29-bf9f-48c5-81c5-4ee770a8f9f9" -d '{"events": [{"server_uuid": "8c572a27-9061-4941-896a-9928a2c08fc0", "name": "network-vif-plugged", "status": "completed", "tag": "ed2f88db-dec4-4610-84e4-2cb90d02fbfd"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:03:57.153079 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port ed2f88db-dec4-4610-84e4-2cb90d02fbfd, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=ed2f88db-dec4-4610-84e4-2cb90d02fbfd,segment=NetworkSegment(b4bbb67e-00c9-4060-91ed-752e106d3acb),segment_id=b4bbb67e-00c9-4060-91ed-752e106d3acb)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:03:57.157548 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:03:57.203848 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=ed2f88db-dec4-4610-84e4-2cb90d02fbfd,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:03:57.232819 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:03:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7c3f2f36-fc16-4e3b-9ae9-846fb3e93d96 x-openstack-request-id: req-7c3f2f36-fc16-4e3b-9ae9-846fb3e93d96 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:03:57.233115 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8c572a27-9061-4941-896a-9928a2c08fc0", "name": "network-vif-plugged", "status": "completed", "tag": "ed2f88db-dec4-4610-84e4-2cb90d02fbfd", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:03:57.233372 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-7c3f2f36-fc16-4e3b-9ae9-846fb3e93d96 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:03:57.233816 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8c572a27-9061-4941-896a-9928a2c08fc0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ed2f88db-dec4-4610-84e4-2cb90d02fbfd', 'code': 200} Sep 01 17:03:57.414235 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0063fe45-4917-44ea-ad3f-b94b00bbf5af req-1a805f0d-63d0-48a1-b60b-68dafee7e86d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:57.415820 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-0063fe45-4917-44ea-ad3f-b94b00bbf5af req-1a805f0d-63d0-48a1-b60b-68dafee7e86d service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 1099 time: 0.0484669 Sep 01 17:03:57.456545 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-0063fe45-4917-44ea-ad3f-b94b00bbf5af req-957b8304-6bbb-4b8e-a24d-acbed3011e27 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320385 Sep 01 17:03:57.822837 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75d0790a-1874-4cb1-8b2f-9b1189547f63 req-256b2981-6fc3-43af-989f-1975ca900331 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:57.824439 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-75d0790a-1874-4cb1-8b2f-9b1189547f63 req-256b2981-6fc3-43af-989f-1975ca900331 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 946 time: 0.0553706 Sep 01 17:03:57.864480 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-75d0790a-1874-4cb1-8b2f-9b1189547f63 req-c769e7bc-21cb-4bfa-8b68-d8e9b1196855 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332963 Sep 01 17:03:58.982294 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-475170f5-08d3-4b86-918a-c4680525fe74 req-8b434d02-1f48-42d3-b2e6-580297ba40c8 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:58.983848 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-475170f5-08d3-4b86-918a-c4680525fe74 req-8b434d02-1f48-42d3-b2e6-580297ba40c8 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 946 time: 0.0529938 Sep 01 17:03:59.025613 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-475170f5-08d3-4b86-918a-c4680525fe74 req-848044e4-dc1a-49e2-b084-b1f4a1887a56 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0352726 Sep 01 17:03:59.720685 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a3cdda9-0e2a-4115-924f-fffcea3a337c req-53fdc253-0831-491d-af83-377a0272e4d2 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:03:59.722129 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3a3cdda9-0e2a-4115-924f-fffcea3a337c req-53fdc253-0831-491d-af83-377a0272e4d2 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 946 time: 0.0513980 Sep 01 17:03:59.761097 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3a3cdda9-0e2a-4115-924f-fffcea3a337c req-ec13f2ae-4023-4bd3-9467-d3b87d94b503 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326400 Sep 01 17:04:00.873626 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59664) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:04:00.884858 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e0d076b-d3e7-4bb5-abba-4ef52b61ba15 req-803c3e96-58b8-4936-ba47-eee974765e0d tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:00.886429 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6e0d076b-d3e7-4bb5-abba-4ef52b61ba15 req-803c3e96-58b8-4936-ba47-eee974765e0d tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 946 time: 0.0550749 Sep 01 17:04:00.917830 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_v2 [None req-4440becf-d4ec-469f-adfb-1eb2870ed567 admin admin] Deleting subnet 666c0d30-db52-4561-9b93-97a824a51a0d {{(pid=93835) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 17:04:00.920849 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4440becf-d4ec-469f-adfb-1eb2870ed567 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:00.924987 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6e0d076b-d3e7-4bb5-abba-4ef52b61ba15 req-fe832ba4-4b8d-4241-9bf9-622e69e74a8c tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/security-groups?id=adab84f7-bdb1-4f3f-865d-d1b646c5f335&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324204 Sep 01 17:04:00.960181 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4440becf-d4ec-469f-adfb-1eb2870ed567 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8197692'] for subnet, precommit_delete_associations {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:00.998626 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4440becf-d4ec-469f-adfb-1eb2870ed567 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.051016 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4440becf-d4ec-469f-adfb-1eb2870ed567 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7342711', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5120114'] for subnet, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.078214 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4440becf-d4ec-469f-adfb-1eb2870ed567 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=666c0d30-db52-4561-9b93-97a824a51a0d,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:01.080436 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4440becf-d4ec-469f-adfb-1eb2870ed567 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.082408 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-4440becf-d4ec-469f-adfb-1eb2870ed567 admin admin] 10.222.0.67 "DELETE /v2.0/subnets/666c0d30-db52-4561-9b93-97a824a51a0d HTTP/1.1" status: 204 len: 168 time: 0.2077904 Sep 01 17:04:01.084827 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59666) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:04:01.158916 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3240a68c-8e51-4710-b8fb-21a3d796be52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.260260 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3240a68c-8e51-4710-b8fb-21a3d796be52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.274407 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-3240a68c-8e51-4710-b8fb-21a3d796be52 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['50a57de3-5738-4399-9f1b-3d7d294c86dc']}} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:01.291954 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-3240a68c-8e51-4710-b8fb-21a3d796be52 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '908c9756-53a1-4c99-846c-262c66bbb074') {'for_net_delete': True} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:01.292192 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-3240a68c-8e51-4710-b8fb-21a3d796be52 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '908c9756-53a1-4c99-846c-262c66bbb074') {} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:01.301985 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a6820ad-6ae2-4e70-8a42-b21eed1d1843 req-dba75da5-d989-4378-b9c6-0cc53a763637 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:01.303449 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-1a6820ad-6ae2-4e70-8a42-b21eed1d1843 req-dba75da5-d989-4378-b9c6-0cc53a763637 tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.69 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 946 time: 0.0798023 Sep 01 17:04:01.311112 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3240a68c-8e51-4710-b8fb-21a3d796be52 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8197639'] for segment, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.346165 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3240a68c-8e51-4710-b8fb-21a3d796be52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.357801 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3240a68c-8e51-4710-b8fb-21a3d796be52 admin admin] Releasing vlan 521 on physical network physnet1 to pool {{(pid=93835) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 17:04:01.358195 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3240a68c-8e51-4710-b8fb-21a3d796be52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7342797'] for segment, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: Traceback (most recent call last): Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: timer() Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: cb(*args, **kw) Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: return func(*args, **kwargs) Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: self._notify() Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: self.callback(batched_events) Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: event.method(event) Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: return f(self, *a, **k) Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._get(url).json() Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: return self.request(url, 'GET', **kwargs) Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 17:04:01.360377 dv-cinder-799668-16-iscsi neutron-server[93835]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 17:04:01.445336 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3240a68c-8e51-4710-b8fb-21a3d796be52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.454077 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-3240a68c-8e51-4710-b8fb-21a3d796be52 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.456046 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-3240a68c-8e51-4710-b8fb-21a3d796be52 admin admin] 10.222.0.67 "DELETE /v2.0/networks/50a57de3-5738-4399-9f1b-3d7d294c86dc HTTP/1.1" status: 204 len: 168 time: 0.3702791 Sep 01 17:04:01.473565 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3240a68c-8e51-4710-b8fb-21a3d796be52 admin admin] Pushing event deleted for resources: {'Network': ['ID=50a57de3-5738-4399-9f1b-3d7d294c86dc,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:01.484547 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-1a6820ad-6ae2-4e70-8a42-b21eed1d1843 req-3d6a80ba-f222-46cb-97ed-eaf55c7ccd9b tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Deleting port ed2f88db-dec4-4610-84e4-2cb90d02fbfd {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:04:01.484896 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-1a6820ad-6ae2-4e70-8a42-b21eed1d1843 req-3d6a80ba-f222-46cb-97ed-eaf55c7ccd9b tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.574046 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-1a6820ad-6ae2-4e70-8a42-b21eed1d1843 req-3d6a80ba-f222-46cb-97ed-eaf55c7ccd9b tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] For port ed2f88db-dec4-4610-84e4-2cb90d02fbfd, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=ed2f88db-dec4-4610-84e4-2cb90d02fbfd,segment=NetworkSegment(b4bbb67e-00c9-4060-91ed-752e106d3acb),segment_id=b4bbb67e-00c9-4060-91ed-752e106d3acb)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:04:01.574434 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-1a6820ad-6ae2-4e70-8a42-b21eed1d1843 req-3d6a80ba-f222-46cb-97ed-eaf55c7ccd9b tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.589017 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-1a6820ad-6ae2-4e70-8a42-b21eed1d1843 req-3d6a80ba-f222-46cb-97ed-eaf55c7ccd9b tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Calling delete_port for ed2f88db-dec4-4610-84e4-2cb90d02fbfd owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:04:01.589182 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:04:01.630201 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59672) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:04:01.684547 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-691d054e-f75e-4605-b1a1-6769ab41c9c0 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=7ddcba698dfe424a89ef6b0fa2e10ae6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0530040 Sep 01 17:04:01.685419 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59676) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:04:01.733301 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-1a6820ad-6ae2-4e70-8a42-b21eed1d1843 req-3d6a80ba-f222-46cb-97ed-eaf55c7ccd9b tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.736880 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-30fbfc5a-00bf-46af-ad89-f0d87a826dfd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.748855 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['ed2f88db-dec4-4610-84e4-2cb90d02fbfd'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:04:01.764638 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-30fbfc5a-00bf-46af-ad89-f0d87a826dfd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.769538 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d6a80ba-f222-46cb-97ed-eaf55c7ccd9b tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Pushing event deleted for resources: {'Port': ['ID=ed2f88db-dec4-4610-84e4-2cb90d02fbfd,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:01.813082 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-1a6820ad-6ae2-4e70-8a42-b21eed1d1843 req-3d6a80ba-f222-46cb-97ed-eaf55c7ccd9b tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] No DVR routers for this DVR port ed2f88db-dec4-4610-84e4-2cb90d02fbfd on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:04:01.815685 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-1a6820ad-6ae2-4e70-8a42-b21eed1d1843 req-3d6a80ba-f222-46cb-97ed-eaf55c7ccd9b tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.817706 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-1a6820ad-6ae2-4e70-8a42-b21eed1d1843 req-3d6a80ba-f222-46cb-97ed-eaf55c7ccd9b tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.69 "DELETE /v2.0/ports/ed2f88db-dec4-4610-84e4-2cb90d02fbfd HTTP/1.1" status: 204 len: 173 time: 0.5048306 Sep 01 17:04:01.818170 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8c572a27-9061-4941-896a-9928a2c08fc0', 'name': 'network-vif-deleted', 'tag': 'ed2f88db-dec4-4610-84e4-2cb90d02fbfd'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:04:01.820433 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a9de03d4-2b51-44c3-882f-2175cabc4bb5" -d '{"events": [{"server_uuid": "8c572a27-9061-4941-896a-9928a2c08fc0", "name": "network-vif-deleted", "tag": "ed2f88db-dec4-4610-84e4-2cb90d02fbfd"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:04:01.832072 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-30fbfc5a-00bf-46af-ad89-f0d87a826dfd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.834842 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-30fbfc5a-00bf-46af-ad89-f0d87a826dfd admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:01.836006 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-30fbfc5a-00bf-46af-ad89-f0d87a826dfd admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/88fc5a2a-1857-470b-a3f9-70d8551b6f2f HTTP/1.1" status: 204 len: 168 time: 0.1499507 Sep 01 17:04:01.853790 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30fbfc5a-00bf-46af-ad89-f0d87a826dfd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88fc5a2a-1857-470b-a3f9-70d8551b6f2f,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:01.864514 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:04:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e31a001-2c90-46fb-91e6-71884ba5e3d6 x-openstack-request-id: req-4e31a001-2c90-46fb-91e6-71884ba5e3d6 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:04:01.864906 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8c572a27-9061-4941-896a-9928a2c08fc0", "name": "network-vif-deleted", "tag": "ed2f88db-dec4-4610-84e4-2cb90d02fbfd", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:04:01.865262 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-4e31a001-2c90-46fb-91e6-71884ba5e3d6 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:04:01.865866 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8c572a27-9061-4941-896a-9928a2c08fc0', 'name': 'network-vif-deleted', 'tag': 'ed2f88db-dec4-4610-84e4-2cb90d02fbfd', 'status': 'completed', 'code': 200} Sep 01 17:04:02.037534 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8e862678-fe90-47d3-a114-1b1cfe8c6344 req-04cc49f9-00d1-4869-95e3-255e9dd8c3ee tempest-VolumesActionsTest-1357913383 tempest-VolumesActionsTest-1357913383-project] 10.222.0.67 "GET /v2.0/ports?device_id=8c572a27-9061-4941-896a-9928a2c08fc0 HTTP/1.1" status: 200 len: 210 time: 0.0318704 Sep 01 17:04:02.371257 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-8469c64c-be7a-4f6e-9a40-794fc66dad79 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-79708857&fields=id&tenant_id=59475fb517464851810daf1967046d0c HTTP/1.1" status: 200 len: 267 time: 0.0328567 Sep 01 17:04:02.475135 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-c0c29823-8f5c-4740-bc3b-b8ee9f3a3172 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:02.476560 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-c0c29823-8f5c-4740-bc3b-b8ee9f3a3172 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/networks?id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f HTTP/1.1" status: 200 len: 809 time: 0.0976892 Sep 01 17:04:02.491829 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-5aaaa4ec-6139-4a2f-b9a9-068b29a68f55 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/quotas/59475fb517464851810daf1967046d0c HTTP/1.1" status: 200 len: 375 time: 0.0095520 Sep 01 17:04:02.545087 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-bfc0fe08-441f-48bf-a8cc-960c12605aa8 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=59475fb517464851810daf1967046d0c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0481009 Sep 01 17:04:02.637566 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-ad391a80-db74-41f4-ade5-0991e23f38f5 service neutron] 10.222.0.67 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0809286 Sep 01 17:04:02.728819 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-4ef4992b-376d-49a8-bac5-27c3b10f4799 service neutron] 10.222.0.67 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847635 Sep 01 17:04:03.006977 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-46a1701c-1d51-4e76-86e7-b82b1c7402e1 req-c30a175f-eee9-4d59-b96e-19802d8da2cf tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 210 time: 0.0270805 Sep 01 17:04:03.969980 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-5afc8028-7e97-4ffb-baa3-29b8aea90474 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:03.971532 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-5afc8028-7e97-4ffb-baa3-29b8aea90474 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.69 "GET /v2.0/networks?id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f HTTP/1.1" status: 200 len: 809 time: 0.1078017 Sep 01 17:04:04.018278 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-5b40194a-aae2-416c-8222-7ece01ad2d10 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=59475fb517464851810daf1967046d0c HTTP/1.1" status: 200 len: 378 time: 0.0353060 Sep 01 17:04:04.053751 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e6037763-99f4-4d65-9897-a597065d057a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Request body: {'port': {'device_id': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'admin_state_up': True, 'tenant_id': '59475fb517464851810daf1967046d0c', 'security_groups': ['339064c2-239b-4c4c-877a-f7185ea53d6b']}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:04:04.102078 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e4856ed7-9ec5-458f-8dc4-fd1d382f4ee3 req-cff83311-babd-4d26-8e69-5d5247e7d1b9 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 210 time: 0.0296254 Sep 01 17:04:04.164877 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e6037763-99f4-4d65-9897-a597065d057a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Made reservation on behalf of 59475fb517464851810daf1967046d0c for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:04:04.168328 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e6037763-99f4-4d65-9897-a597065d057a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:04.289233 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e6037763-99f4-4d65-9897-a597065d057a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Allocated IP 172.20.0.6 (e985feb4-0a78-4f0e-ad7c-52a73023bf6f/53347cb0-0e42-4047-9ec0-95b809608613/aec9941f-617a-4d03-a98b-27c5fea3c635) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:04:04.425683 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e6037763-99f4-4d65-9897-a597065d057a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:04.438938 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e6037763-99f4-4d65-9897-a597065d057a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Transition to ACTIVE for port object aec9941f-617a-4d03-a98b-27c5fea3c635 will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:04:04.470718 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e6037763-99f4-4d65-9897-a597065d057a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:04.514302 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e6037763-99f4-4d65-9897-a597065d057a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Network e985feb4-0a78-4f0e-ad7c-52a73023bf6f is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:04:04.517503 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e6037763-99f4-4d65-9897-a597065d057a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:04:04.521253 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e6037763-99f4-4d65-9897-a597065d057a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:04:04.527628 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6037763-99f4-4d65-9897-a597065d057a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Pushing event updated for resources: {'Port': ['ID=aec9941f-617a-4d03-a98b-27c5fea3c635,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:04.575145 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e6037763-99f4-4d65-9897-a597065d057a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:04.575502 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e6037763-99f4-4d65-9897-a597065d057a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:04.590270 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e6037763-99f4-4d65-9897-a597065d057a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5405858 Sep 01 17:04:04.847697 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-fffb361f-3aed-4509-a2ba-2ef31bdbe41b None None] Provisioning for port aec9941f-617a-4d03-a98b-27c5fea3c635 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:04:04.851441 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-fffb361f-3aed-4509-a2ba-2ef31bdbe41b None None] Provisioning complete for port aec9941f-617a-4d03-a98b-27c5fea3c635 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:04:04.851816 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-fffb361f-3aed-4509-a2ba-2ef31bdbe41b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:04.889822 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-fffb361f-3aed-4509-a2ba-2ef31bdbe41b None None] Port aec9941f-617a-4d03-a98b-27c5fea3c635 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:04:05.218372 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c379435-9206-4650-adf4-36d127403f9d req-4cd0b235-e700-4330-9838-e0d949084f33 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:05.220389 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6c379435-9206-4650-adf4-36d127403f9d req-4cd0b235-e700-4330-9838-e0d949084f33 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 931 time: 0.0484352 Sep 01 17:04:05.257355 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6c379435-9206-4650-adf4-36d127403f9d req-1314a3d0-f5e6-40ca-a296-a4a26b537991 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0308239 Sep 01 17:04:06.376847 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d297c4-7bfc-440a-8d37-7278b5aceeaf req-43b18ec3-1054-406b-91a7-b67279a3beb8 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:06.378465 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d5d297c4-7bfc-440a-8d37-7278b5aceeaf req-43b18ec3-1054-406b-91a7-b67279a3beb8 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 931 time: 0.0483880 Sep 01 17:04:06.419270 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d5d297c4-7bfc-440a-8d37-7278b5aceeaf req-bca1cc3a-9991-40fc-b316-bad89419601f tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0349143 Sep 01 17:04:06.705850 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Request body: {'port': {'device_id': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:04:06.709728 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device ed2f88db-dec4-4610-84e4-2cb90d02fbfd no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:04:06.729268 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: ed2f88db-dec4-4610-84e4-2cb90d02fbfd {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:04:06.729648 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device ed2f88db-dec4-4610-84e4-2cb90d02fbfd not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:04:06.768670 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:07.026094 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id aec9941f-617a-4d03-a98b-27c5fea3c635 {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:04:07.033400 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:07.045521 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Transition to ACTIVE for port object aec9941f-617a-4d03-a98b-27c5fea3c635 will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:04:07.049739 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:07.122062 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Pushing event updated for resources: {'Port': ['ID=aec9941f-617a-4d03-a98b-27c5fea3c635,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:07.175686 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Attempting to bind port aec9941f-617a-4d03-a98b-27c5fea3c635 on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:04:07.176021 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Attempting to bind port aec9941f-617a-4d03-a98b-27c5fea3c635 by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': '7629b231-1a75-4951-b23d-eecb3ccb3fd6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:04:07.176357 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Attempting to bind port aec9941f-617a-4d03-a98b-27c5fea3c635 on network e985feb4-0a78-4f0e-ad7c-52a73023bf6f {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:04:07.181106 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Port aec9941f-617a-4d03-a98b-27c5fea3c635 on network e985feb4-0a78-4f0e-ad7c-52a73023bf6f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:04:07.181268 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Attempting to bind port aec9941f-617a-4d03-a98b-27c5fea3c635 on network e985feb4-0a78-4f0e-ad7c-52a73023bf6f {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:04:07.186360 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 3, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:04:07.186705 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Checking segment: {'id': '7629b231-1a75-4951-b23d-eecb3ccb3fd6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:04:07.187098 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Bound using segment: {'id': '7629b231-1a75-4951-b23d-eecb3ccb3fd6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:04:07.187678 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Bound port: aec9941f-617a-4d03-a98b-27c5fea3c635, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7629b231-1a75-4951-b23d-eecb3ccb3fd6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:04:07.188046 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:07.254363 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] For port aec9941f-617a-4d03-a98b-27c5fea3c635, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:04:07.257508 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] For port aec9941f-617a-4d03-a98b-27c5fea3c635, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=aec9941f-617a-4d03-a98b-27c5fea3c635,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:04:07.261473 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:07.294224 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:07.294845 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:07.296252 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] 10.222.0.69 "PUT /v2.0/ports/aec9941f-617a-4d03-a98b-27c5fea3c635 HTTP/1.1" status: 200 len: 1093 time: 0.5948596 Sep 01 17:04:07.296682 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'tag': 'aec9941f-617a-4d03-a98b-27c5fea3c635'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:04:07.299147 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e8bb0c6f-1e91-4e53-b05d-4776366165cc" -d '{"events": [{"name": "network-changed", "server_uuid": "ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1", "tag": "aec9941f-617a-4d03-a98b-27c5fea3c635"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:04:07.326325 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57efe54b-5520-4f5c-9e10-34ce47cac216 service neutron] Pushing event updated for resources: {'Port': ['ID=aec9941f-617a-4d03-a98b-27c5fea3c635,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:07.363673 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:04:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e620c3ea-6628-4fa1-be0f-2b77dbb27791 x-openstack-request-id: req-e620c3ea-6628-4fa1-be0f-2b77dbb27791 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:04:07.363966 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1", "tag": "aec9941f-617a-4d03-a98b-27c5fea3c635", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:04:07.364199 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-e620c3ea-6628-4fa1-be0f-2b77dbb27791 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:04:07.365206 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'tag': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'status': 'completed', 'code': 200} Sep 01 17:04:07.400178 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e9875774-0962-438d-9f83-b966ff7e2e84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:07.402031 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e9875774-0962-438d-9f83-b966ff7e2e84 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=59475fb517464851810daf1967046d0c&device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 1096 time: 0.0487981 Sep 01 17:04:07.450791 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-d831f580-c44f-4fed-af85-996ca190c496 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=aec9941f-617a-4d03-a98b-27c5fea3c635 HTTP/1.1" status: 200 len: 217 time: 0.0385027 Sep 01 17:04:07.515532 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-8ca74026-e772-4f9b-b13f-58bfa4c396d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:07.517911 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-8ca74026-e772-4f9b-b13f-58bfa4c396d6 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=53347cb0-0e42-4047-9ec0-95b809608613 HTTP/1.1" status: 200 len: 848 time: 0.0530477 Sep 01 17:04:07.544464 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a1bbfb-6657-40cf-b52e-92b6e1ced3b3 req-26f70cc5-0df6-4d2f-90b6-42a663d046e2 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:07.547196 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-02a1bbfb-6657-40cf-b52e-92b6e1ced3b3 req-26f70cc5-0df6-4d2f-90b6-42a663d046e2 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 943 time: 0.0540090 Sep 01 17:04:07.589618 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-02a1bbfb-6657-40cf-b52e-92b6e1ced3b3 req-1e460f12-6b91-459d-8e1c-77de91902f01 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0351980 Sep 01 17:04:07.590162 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-fe760b85-b74b-4383-b470-21adc8aee728 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:07.591673 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-fe760b85-b74b-4383-b470-21adc8aee728 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0596919 Sep 01 17:04:07.691392 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-d776a8eb-ff42-4bb6-832a-165fdb05267d service neutron] 10.222.0.69 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0897603 Sep 01 17:04:07.803507 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c18af6a2-a370-436e-baf3-3c37919f2654 req-e6fc111d-38af-480c-8b78-e3523adb6001 service neutron] 10.222.0.69 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1020808 Sep 01 17:04:07.918201 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8bb0c6f-1e91-4e53-b05d-4776366165cc req-ec4f003d-18c1-4e91-a64e-4f41c0531e12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:07.919956 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e8bb0c6f-1e91-4e53-b05d-4776366165cc req-ec4f003d-18c1-4e91-a64e-4f41c0531e12 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=59475fb517464851810daf1967046d0c&device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 1096 time: 0.0482430 Sep 01 17:04:08.027924 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8bb0c6f-1e91-4e53-b05d-4776366165cc req-fc22395f-9a01-4dc7-b217-441b837db9b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:08.029642 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e8bb0c6f-1e91-4e53-b05d-4776366165cc req-fc22395f-9a01-4dc7-b217-441b837db9b1 service neutron] 10.222.0.69 "GET /v2.0/networks?id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f HTTP/1.1" status: 200 len: 910 time: 0.0990872 Sep 01 17:04:08.093159 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e8bb0c6f-1e91-4e53-b05d-4776366165cc req-11f20a11-9e5e-42ee-92a4-fd4d2500eb2f service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=aec9941f-617a-4d03-a98b-27c5fea3c635 HTTP/1.1" status: 200 len: 217 time: 0.0517724 Sep 01 17:04:08.392907 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8bb0c6f-1e91-4e53-b05d-4776366165cc req-c2ad09f3-8b3a-42ae-9e2d-ed5e1a334676 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:08.394420 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e8bb0c6f-1e91-4e53-b05d-4776366165cc req-c2ad09f3-8b3a-42ae-9e2d-ed5e1a334676 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=53347cb0-0e42-4047-9ec0-95b809608613 HTTP/1.1" status: 200 len: 848 time: 0.2925096 Sep 01 17:04:08.443376 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8bb0c6f-1e91-4e53-b05d-4776366165cc req-818ed041-371f-49bc-88dd-c54c892694da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:08.445864 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e8bb0c6f-1e91-4e53-b05d-4776366165cc req-818ed041-371f-49bc-88dd-c54c892694da service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0433595 Sep 01 17:04:08.558557 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e8bb0c6f-1e91-4e53-b05d-4776366165cc req-2f52b736-d948-482e-a785-94c561c08336 service neutron] 10.222.0.69 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1026554 Sep 01 17:04:08.673551 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e8bb0c6f-1e91-4e53-b05d-4776366165cc req-f2a86aaa-7276-454e-9257-c34d5a2df4a1 service neutron] 10.222.0.69 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1055446 Sep 01 17:04:08.735118 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b2aa7c1-a60a-493c-b6cc-72ca0a54a3a1 req-3f98a139-10d3-433a-94fc-b6885e1a0837 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:08.737262 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1b2aa7c1-a60a-493c-b6cc-72ca0a54a3a1 req-3f98a139-10d3-433a-94fc-b6885e1a0837 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 943 time: 0.0701165 Sep 01 17:04:08.794471 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1b2aa7c1-a60a-493c-b6cc-72ca0a54a3a1 req-9345b2c9-a5da-41d0-9a71-520e41019c04 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0500214 Sep 01 17:04:09.928777 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b99d3ea9-226e-4718-bc81-6213670042ef req-11f8d134-f672-43d6-be87-afec0d57a286 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:09.930600 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b99d3ea9-226e-4718-bc81-6213670042ef req-11f8d134-f672-43d6-be87-afec0d57a286 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 943 time: 0.0645370 Sep 01 17:04:09.988794 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b99d3ea9-226e-4718-bc81-6213670042ef req-d54d441a-6880-491c-91d1-8ec5039c9668 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0490997 Sep 01 17:04:11.395139 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aad6aae5-3e55-41e4-842f-ff85c775538c req-1c1c6145-f8f5-4afb-808c-2bfbcee9e3af tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:11.403068 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-aad6aae5-3e55-41e4-842f-ff85c775538c req-1c1c6145-f8f5-4afb-808c-2bfbcee9e3af tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 943 time: 0.3453298 Sep 01 17:04:11.451078 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-aad6aae5-3e55-41e4-842f-ff85c775538c req-2cf0698c-37cf-449c-9c02-9f1372654593 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0426266 Sep 01 17:04:12.584274 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a28b6a59-965e-4918-9273-75ff8c4edf9b req-645ee737-2222-47b1-8249-a154ae8d33ea tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:12.591735 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a28b6a59-965e-4918-9273-75ff8c4edf9b req-645ee737-2222-47b1-8249-a154ae8d33ea tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 943 time: 0.0581422 Sep 01 17:04:12.636251 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a28b6a59-965e-4918-9273-75ff8c4edf9b req-9efcc4da-44aa-4b77-b56a-30a94d97e94b tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0387480 Sep 01 17:04:13.763280 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2b1d159-c0d9-4f21-8658-22214781ff51 req-d2ee7814-9b67-4749-b032-cb9ac46a488d tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:13.765799 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d2b1d159-c0d9-4f21-8658-22214781ff51 req-d2ee7814-9b67-4749-b032-cb9ac46a488d tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 943 time: 0.0536056 Sep 01 17:04:13.811450 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d2b1d159-c0d9-4f21-8658-22214781ff51 req-2f984466-be5d-448f-94b6-b058d5500146 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0387783 Sep 01 17:04:14.734974 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device aec9941f-617a-4d03-a98b-27c5fea3c635 details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:04:14.843289 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port aec9941f-617a-4d03-a98b-27c5fea3c635, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=aec9941f-617a-4d03-a98b-27c5fea3c635,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:04:14.856255 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'port_id': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'mac_address': 'fa:16:3e:0c:57:0e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 545, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '53347cb0-0e42-4047-9ec0-95b809608613', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:04:14.895413 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:14.908724 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id aec9941f-617a-4d03-a98b-27c5fea3c635 {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:04:14.929348 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port aec9941f-617a-4d03-a98b-27c5fea3c635, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=aec9941f-617a-4d03-a98b-27c5fea3c635,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:04:14.935714 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:14.955667 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7d4af80-ec56-43c2-92b8-860218b5744f req-5013e7c6-499e-4736-b35c-d6a76875dfe0 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:14.966967 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c7d4af80-ec56-43c2-92b8-860218b5744f req-5013e7c6-499e-4736-b35c-d6a76875dfe0 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 943 time: 0.0768809 Sep 01 17:04:14.996837 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=aec9941f-617a-4d03-a98b-27c5fea3c635,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:15.006241 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:15.006913 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:15.007441 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:15.007966 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:15.008489 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:15.009005 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:15.009684 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:15.010347 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:15.010860 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:15.011595 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c7d4af80-ec56-43c2-92b8-860218b5744f req-caa4ea96-25e5-4f52-b84c-a0632e73ab7d tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0435448 Sep 01 17:04:15.011848 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:15.012189 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:15.013104 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:15.212192 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['aec9941f-617a-4d03-a98b-27c5fea3c635'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:04:16.146435 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d720e47f-09c6-4447-aefe-f2eff0193884 req-aae9fb1b-8172-4726-b4ee-8e7e769fc1e2 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:16.148035 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d720e47f-09c6-4447-aefe-f2eff0193884 req-aae9fb1b-8172-4726-b4ee-8e7e769fc1e2 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 944 time: 0.0550880 Sep 01 17:04:16.194126 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d720e47f-09c6-4447-aefe-f2eff0193884 req-c7546ff0-7b47-4d09-b6f3-bdeba17fb43a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0381510 Sep 01 17:04:16.740640 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device aec9941f-617a-4d03-a98b-27c5fea3c635 up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:04:16.802554 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port aec9941f-617a-4d03-a98b-27c5fea3c635 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:04:16.809400 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port aec9941f-617a-4d03-a98b-27c5fea3c635 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:04:16.809400 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:16.900070 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:16.935172 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aec9941f-617a-4d03-a98b-27c5fea3c635'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:04:16.937475 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-78129764-8a3c-4368-81c8-908312b30f13" -d '{"events": [{"server_uuid": "ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1", "name": "network-vif-plugged", "status": "completed", "tag": "aec9941f-617a-4d03-a98b-27c5fea3c635"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:04:16.942020 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port aec9941f-617a-4d03-a98b-27c5fea3c635, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=aec9941f-617a-4d03-a98b-27c5fea3c635,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:04:16.947130 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:17.001868 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=aec9941f-617a-4d03-a98b-27c5fea3c635,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:17.015972 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:04:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc07d932-fd84-4013-887e-4e24be523310 x-openstack-request-id: req-bc07d932-fd84-4013-887e-4e24be523310 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:04:17.015972 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1", "name": "network-vif-plugged", "status": "completed", "tag": "aec9941f-617a-4d03-a98b-27c5fea3c635", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:04:17.015972 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-bc07d932-fd84-4013-887e-4e24be523310 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:04:17.016427 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'code': 200} Sep 01 17:04:17.294865 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-689d3754-03dc-488b-9213-bf6ba241033b req-0ee4a5a5-36b5-474c-98aa-ed415bd9adff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:17.296775 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-689d3754-03dc-488b-9213-bf6ba241033b req-0ee4a5a5-36b5-474c-98aa-ed415bd9adff service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 1098 time: 0.0546005 Sep 01 17:04:17.342727 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-689d3754-03dc-488b-9213-bf6ba241033b req-38174749-bb8f-4775-a12d-361132b23e33 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0376999 Sep 01 17:04:17.344476 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d40efe68-931a-472a-b444-0d5f12a78f3b req-b5fa217c-ae7b-4d7d-9b76-9283fdda8e7d tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:17.347253 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d40efe68-931a-472a-b444-0d5f12a78f3b req-b5fa217c-ae7b-4d7d-9b76-9283fdda8e7d tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0636141 Sep 01 17:04:17.396316 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d40efe68-931a-472a-b444-0d5f12a78f3b req-0ca8e5fd-906b-4ba3-8ea2-5ddffca91621 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0420964 Sep 01 17:04:18.555239 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5eebf87-d431-4914-a118-eb2ee68d62d2 req-ad2cccef-2e67-46f1-a2d7-dd49e31b2213 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:18.556889 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c5eebf87-d431-4914-a118-eb2ee68d62d2 req-ad2cccef-2e67-46f1-a2d7-dd49e31b2213 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0569065 Sep 01 17:04:18.599562 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c5eebf87-d431-4914-a118-eb2ee68d62d2 req-1376a631-37d4-450c-90a2-60eca243711e tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0362892 Sep 01 17:04:19.728562 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deb03d2c-1ee2-4875-bed6-c8be785dbe9f req-9894e511-9e17-4218-beac-949bb355499b tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:19.730121 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-deb03d2c-1ee2-4875-bed6-c8be785dbe9f req-9894e511-9e17-4218-beac-949bb355499b tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0510256 Sep 01 17:04:19.770219 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-deb03d2c-1ee2-4875-bed6-c8be785dbe9f req-657347a0-2d94-4f8d-a86e-8ca8ec246691 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0335820 Sep 01 17:04:19.888962 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b396e2c-160d-43ed-9640-0e75272f91b8 req-90033404-9d8b-4d30-bee9-093dffb403db tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:19.890474 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6b396e2c-160d-43ed-9640-0e75272f91b8 req-90033404-9d8b-4d30-bee9-093dffb403db tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0519059 Sep 01 17:04:19.934765 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6b396e2c-160d-43ed-9640-0e75272f91b8 req-71882288-ac2a-4492-b87f-6d1f570434da tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0373747 Sep 01 17:04:19.957866 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 59900) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:04:20.185043 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-15a23841-bbce-4444-bbe0-20eb6db9493b tempest-TestShelveInstance-957638310 tempest-TestShelveInstance-957638310-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:20.189649 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-15a23841-bbce-4444-bbe0-20eb6db9493b tempest-TestShelveInstance-957638310 tempest-TestShelveInstance-957638310-project-admin] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 1093 time: 0.2278135 Sep 01 17:04:20.190087 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 59908) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:04:20.196473 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Request body: {'floatingip': {'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'port_id': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'tenant_id': '59475fb517464851810daf1967046d0c', 'fixed_ip_address': '172.20.0.6'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:04:20.226692 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for floatingip, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:20.329412 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:20.460237 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Allocated IP 172.27.1.169 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/2d16abf6-6531-4f1d-84cf-8bd074ee11e0) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:04:20.623028 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:20.705120 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:20.752633 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0878db0-4801-484f-87de-62554764240a req-ca225510-61d3-4ff8-ac60-b7215deaee49 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:20.760977 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f0878db0-4801-484f-87de-62554764240a req-ca225510-61d3-4ff8-ac60-b7215deaee49 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 945 time: 0.0651197 Sep 01 17:04:20.776191 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:04:20.790555 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:04:20.797142 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:04:20.812550 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f0878db0-4801-484f-87de-62554764240a req-a335c648-4c75-4ec1-a72e-80bc7fc0ee6f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434618 Sep 01 17:04:20.851967 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Pushing event updated for resources: {'Port': ['ID=2d16abf6-6531-4f1d-84cf-8bd074ee11e0,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:21.248688 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-55446d8a-2449-4d0f-8d29-dd11c615e4b1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:21.309650 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:21.392322 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:21.562813 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:21.567627 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:21.653005 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Pushing event updated for resources: {'Port': ['ID=2d16abf6-6531-4f1d-84cf-8bd074ee11e0,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:21.661039 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:21.776859 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.l3_db [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Floating IP d4c9fab0-c3d4-4237-90ed-12694d6c7e03 associated. External IP: 172.27.1.169, port: aec9941f-617a-4d03-a98b-27c5fea3c635. Sep 01 17:04:21.952752 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c73fa18f-bacf-4078-8552-c6ffc072e7f3 req-c013dc67-023c-4a67-bdf4-2434bc7ad0f7 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:21.955293 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c73fa18f-bacf-4078-8552-c6ffc072e7f3 req-c013dc67-023c-4a67-bdf4-2434bc7ad0f7 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 945 time: 0.0696931 Sep 01 17:04:22.015752 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c73fa18f-bacf-4078-8552-c6ffc072e7f3 req-262fda06-578b-48e9-b250-08ebc7c63368 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0513306 Sep 01 17:04:22.043004 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:04:22.167420 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:04:22.179956 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc97a019-c538-46f8-8d6c-8eb59d56fe39 None None] Sync routers for ids ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:04:22.190872 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc97a019-c538-46f8-8d6c-8eb59d56fe39 None None] Routers {'88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:04:22.191075 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:22.192045 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-cc97a019-c538-46f8-8d6c-8eb59d56fe39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:03:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:22.262410 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-de3ef71d-eed0-4e39-861d-b6569e505d46 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.0711117 Sep 01 17:04:22.263081 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'tag': 'aec9941f-617a-4d03-a98b-27c5fea3c635'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:04:22.267394 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db4d8ef2-e3bd-41a5-8e05-62405c5b729b" -d '{"events": [{"name": "network-changed", "server_uuid": "ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1", "tag": "aec9941f-617a-4d03-a98b-27c5fea3c635"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:04:22.325899 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:04:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bdec1bac-b6ca-44f2-b46c-3ca97d95ce7e x-openstack-request-id: req-bdec1bac-b6ca-44f2-b46c-3ca97d95ce7e {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:04:22.325899 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1", "tag": "aec9941f-617a-4d03-a98b-27c5fea3c635", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:04:22.325899 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-bdec1bac-b6ca-44f2-b46c-3ca97d95ce7e {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:04:22.325899 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'tag': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'status': 'completed', 'code': 200} Sep 01 17:04:22.341501 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-cc97a019-c538-46f8-8d6c-8eb59d56fe39 None None] Set router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:04:22.401003 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-1a04d793-9f65-4b12-8c9e-ce503fbdca41 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:22.402526 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-1a04d793-9f65-4b12-8c9e-ce503fbdca41 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 945 time: 0.0880568 Sep 01 17:04:22.443985 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4d8ef2-e3bd-41a5-8e05-62405c5b729b req-d5422fb5-54da-4061-a843-030c3044cbd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:22.445623 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-db4d8ef2-e3bd-41a5-8e05-62405c5b729b req-d5422fb5-54da-4061-a843-030c3044cbd3 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=59475fb517464851810daf1967046d0c&device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 1098 time: 0.0991960 Sep 01 17:04:22.588325 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Deleting port b4fb0a19-69a3-49ac-877e-9d08996f0c77 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:04:22.588667 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:22.603818 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4d8ef2-e3bd-41a5-8e05-62405c5b729b req-25e77142-f6f1-4e89-a811-438508f95b84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:22.605293 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-db4d8ef2-e3bd-41a5-8e05-62405c5b729b req-25e77142-f6f1-4e89-a811-438508f95b84 service neutron] 10.222.0.69 "GET /v2.0/networks?id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f HTTP/1.1" status: 200 len: 910 time: 0.1503043 Sep 01 17:04:22.636823 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-cc97a019-c538-46f8-8d6c-8eb59d56fe39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75'}], 'enable_snat': True}, 'gw_port_id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:34Z', 'revision_number': 4, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port': {'id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:f8:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': 'd4c9fab0-c3d4-4237-90ed-12694d6c7e03', 'tenant_id': '59475fb517464851810daf1967046d0c', 'floating_ip_address': '172.27.1.169', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'port_id': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 628, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'mac_address': 'fa:16:3e:0c:57:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:04:21Z', 'updated_at': '2021-09-01T17:04:21Z', 'revision_number': 0, 'project_id': '59475fb517464851810daf1967046d0c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b3f5695a-1b76-4688-983b-02a2efc00c3e', 'name': '', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'tenant_id': '59475fb517464851810daf1967046d0c', 'mac_address': 'fa:16:3e:1b:db:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 603, 'fixed_ips': [{'subnet_id': '53347cb0-0e42-4047-9ec0-95b809608613', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:33Z', 'updated_at': '2021-09-01T17:03:39Z', 'revision_number': 5, 'project_id': '59475fb517464851810daf1967046d0c', 'subnets': [{'id': '53347cb0-0e42-4047-9ec0-95b809608613', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:22.667780 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc97a019-c538-46f8-8d6c-8eb59d56fe39 None None] Checking router: 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:04:22.676923 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc97a019-c538-46f8-8d6c-8eb59d56fe39 None None] Routers {'88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:04:22.677467 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-cc97a019-c538-46f8-8d6c-8eb59d56fe39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:03:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:22.717881 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-db4d8ef2-e3bd-41a5-8e05-62405c5b729b req-f5a6152d-d5b3-49fd-8b0f-6e1add26f8d2 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=aec9941f-617a-4d03-a98b-27c5fea3c635 HTTP/1.1" status: 200 len: 999 time: 0.0875075 Sep 01 17:04:22.736421 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] For port b4fb0a19-69a3-49ac-877e-9d08996f0c77, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=b4fb0a19-69a3-49ac-877e-9d08996f0c77,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:04:22.736786 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:22.781259 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-cc97a019-c538-46f8-8d6c-8eb59d56fe39 None None] Set router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:04:22.817163 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4d8ef2-e3bd-41a5-8e05-62405c5b729b req-075558cb-274e-459c-9a4f-f26e2eef6dfd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:22.818663 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-db4d8ef2-e3bd-41a5-8e05-62405c5b729b req-075558cb-274e-459c-9a4f-f26e2eef6dfd service neutron] 10.222.0.69 "GET /v2.0/subnets?id=53347cb0-0e42-4047-9ec0-95b809608613 HTTP/1.1" status: 200 len: 848 time: 0.0909562 Sep 01 17:04:22.945063 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4d8ef2-e3bd-41a5-8e05-62405c5b729b req-f40af28e-e20c-41ea-913e-b935867b02b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:22.946515 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-db4d8ef2-e3bd-41a5-8e05-62405c5b729b req-f40af28e-e20c-41ea-913e-b935867b02b4 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1195371 Sep 01 17:04:23.005752 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for floatingip, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:23.006132 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:23.006447 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.l3_db [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Floating IP b33920bd-7a8f-47e0-98fb-6aec89374880 disassociated. External IP: 172.27.1.70, port: b4fb0a19-69a3-49ac-877e-9d08996f0c77. Sep 01 17:04:23.006788 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Calling delete_port for b4fb0a19-69a3-49ac-877e-9d08996f0c77 owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:04:23.007667 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-cc97a019-c538-46f8-8d6c-8eb59d56fe39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75'}], 'enable_snat': True}, 'gw_port_id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:34Z', 'revision_number': 4, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port': {'id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:f8:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': 'd4c9fab0-c3d4-4237-90ed-12694d6c7e03', 'tenant_id': '59475fb517464851810daf1967046d0c', 'floating_ip_address': '172.27.1.169', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'port_id': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 628, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'mac_address': 'fa:16:3e:0c:57:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:04:21Z', 'updated_at': '2021-09-01T17:04:21Z', 'revision_number': 0, 'project_id': '59475fb517464851810daf1967046d0c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b3f5695a-1b76-4688-983b-02a2efc00c3e', 'name': '', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'tenant_id': '59475fb517464851810daf1967046d0c', 'mac_address': 'fa:16:3e:1b:db:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 603, 'fixed_ips': [{'subnet_id': '53347cb0-0e42-4047-9ec0-95b809608613', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:33Z', 'updated_at': '2021-09-01T17:03:39Z', 'revision_number': 5, 'project_id': '59475fb517464851810daf1967046d0c', 'subnets': [{'id': '53347cb0-0e42-4047-9ec0-95b809608613', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:23.039823 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc97a019-c538-46f8-8d6c-8eb59d56fe39 None None] The sync data for ids ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'] in dv-cinder-799668-16-iscsi is: [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75'}], 'enable_snat': True}, 'gw_port_id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:34Z', 'revision_number': 4, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port': {'id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:f8:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': 'd4c9fab0-c3d4-4237-90ed-12694d6c7e03', 'tenant_id': '59475fb517464851810daf1967046d0c', 'floating_ip_address': '172.27.1.169', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'port_id': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 628, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'mac_address': 'fa:16:3e:0c:57:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:04:21Z', 'updated_at': '2021-09-01T17:04:21Z', 'revision_number': 0, 'project_id': '59475fb517464851810daf1967046d0c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b3f5695a-1b76-4688-983b-02a2efc00c3e', 'name': '', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'tenant_id': '59475fb517464851810daf1967046d0c', 'mac_address': 'fa:16:3e:1b:db:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 603, 'fixed_ips': [{'subnet_id': '53347cb0-0e42-4047-9ec0-95b809608613', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:33Z', 'updated_at': '2021-09-01T17:03:39Z', 'revision_number': 5, 'project_id': '59475fb517464851810daf1967046d0c', 'subnets': [{'id': '53347cb0-0e42-4047-9ec0-95b809608613', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:04:23.096855 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-db4d8ef2-e3bd-41a5-8e05-62405c5b729b req-b35abc7d-183f-4324-acf5-54ddc64c2ad4 service neutron] 10.222.0.69 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1403975 Sep 01 17:04:23.151052 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-402777ae-1d18-467c-9f9c-2ae0d8f1c60e req-a2eb1a77-fc4e-4bff-9425-fbc4e419d8f1 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:23.152558 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-402777ae-1d18-467c-9f9c-2ae0d8f1c60e req-a2eb1a77-fc4e-4bff-9425-fbc4e419d8f1 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 945 time: 0.0501444 Sep 01 17:04:23.198090 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-402777ae-1d18-467c-9f9c-2ae0d8f1c60e req-41352305-0204-4834-b3ce-23b9aa6ef637 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385301 Sep 01 17:04:23.251537 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-db4d8ef2-e3bd-41a5-8e05-62405c5b729b req-fd8fb774-a1e5-4e39-a3ff-42aa27dc7d44 service neutron] 10.222.0.69 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1455169 Sep 01 17:04:23.252973 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:23.262186 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c31fabd-35d4-4cf9-bf3d-5fd9f65a77a5 None None] New status for floating IP d4c9fab0-c3d4-4237-90ed-12694d6c7e03: ACTIVE {{(pid=93838) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:04:23.290299 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event deleted for resources: {'Port': ['ID=b4fb0a19-69a3-49ac-877e-9d08996f0c77,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:23.432260 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:04:23.782236 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:23.788699 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-0e48cc03-d678-4bd2-b294-10633e488b13 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:23.810623 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:04:23.821580 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f243dec3-ba7b-44e9-befb-d57ae8862b6b None None] Sync routers for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:04:23.841130 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f243dec3-ba7b-44e9-befb-d57ae8862b6b None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:04:23.841130 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-f243dec3-ba7b-44e9-befb-d57ae8862b6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:04:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:23.855717 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] No DVR routers for this DVR port b4fb0a19-69a3-49ac-877e-9d08996f0c77 on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:04:23.859180 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:23.861967 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-faa0f0cb-a92c-4c9f-b6f8-6c984beb3892 req-d5bcfc2d-ea93-4e86-a294-9ac60e0ae681 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "DELETE /v2.0/ports/b4fb0a19-69a3-49ac-877e-9d08996f0c77 HTTP/1.1" status: 204 len: 173 time: 1.4526653 Sep 01 17:04:23.965684 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-f243dec3-ba7b-44e9-befb-d57ae8862b6b None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:04:24.171100 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-f243dec3-ba7b-44e9-befb-d57ae8862b6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:24.197550 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f243dec3-ba7b-44e9-befb-d57ae8862b6b None None] Checking router: 8724afe3-ad3a-4d4f-94c4-4642b6e0afab for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:04:24.207039 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f243dec3-ba7b-44e9-befb-d57ae8862b6b None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:04:24.207635 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-f243dec3-ba7b-44e9-befb-d57ae8862b6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:04:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:24.308867 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f44c3a67-fee2-419f-9220-5a0402ecc612 req-2717f85e-fa72-42b0-af9c-060c70be46f0 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4 HTTP/1.1" status: 200 len: 210 time: 0.0288894 Sep 01 17:04:24.331518 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4', 'name': 'network-vif-deleted', 'tag': 'b4fb0a19-69a3-49ac-877e-9d08996f0c77'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:04:24.331518 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b872c763-4580-49b0-ba44-7caef87655a6" -d '{"events": [{"server_uuid": "f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4", "name": "network-vif-deleted", "tag": "b4fb0a19-69a3-49ac-877e-9d08996f0c77"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:04:24.365858 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:04:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-db2777a1-6fbf-47bf-b111-3c00bf76a915 x-openstack-request-id: req-db2777a1-6fbf-47bf-b111-3c00bf76a915 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:04:24.366153 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4", "name": "network-vif-deleted", "tag": "b4fb0a19-69a3-49ac-877e-9d08996f0c77", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:04:24.366408 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-db2777a1-6fbf-47bf-b111-3c00bf76a915 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:04:24.366837 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f5dce1c1-c1c5-4ae1-bd98-8fc54e98b8a4', 'name': 'network-vif-deleted', 'tag': 'b4fb0a19-69a3-49ac-877e-9d08996f0c77', 'status': 'completed', 'code': 200} Sep 01 17:04:24.444238 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-f243dec3-ba7b-44e9-befb-d57ae8862b6b None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:04:24.653667 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-f243dec3-ba7b-44e9-befb-d57ae8862b6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:24.680099 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f243dec3-ba7b-44e9-befb-d57ae8862b6b None None] The sync data for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi is: [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:04:24.760749 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device b4fb0a19-69a3-49ac-877e-9d08996f0c77 no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:04:24.781942 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: b4fb0a19-69a3-49ac-877e-9d08996f0c77 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:04:24.782286 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device b4fb0a19-69a3-49ac-877e-9d08996f0c77 not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:04:24.904499 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2800ee0b-f0cd-4f04-ac29-3d010d95d5dc None None] New status for floating IP b33920bd-7a8f-47e0-98fb-6aec89374880: DOWN {{(pid=93838) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:04:24.913595 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:24.987358 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60010) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:04:25.036207 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_v2 [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Deleting subnet f7abf916-2e22-4954-874c-6d7775564f14 {{(pid=93836) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 17:04:25.039384 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.074976 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5815122'] for subnet, precommit_delete_associations {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.112719 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.163157 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6279800', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6181087'] for subnet, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.188925 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f7abf916-2e22-4954-874c-6d7775564f14,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:25.191303 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Notify callbacks [] for subnet, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.193121 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] 10.222.0.67 "DELETE /v2.0/subnets/f7abf916-2e22-4954-874c-6d7775564f14 HTTP/1.1" status: 204 len: 168 time: 0.2047076 Sep 01 17:04:25.195787 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60012) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:04:25.199003 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:25.199357 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:25.199701 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:25.200041 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:25.200375 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:25.200708 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:25.201039 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:25.201370 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:25.201721 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:25.202049 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:25.202374 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:25.202704 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e2ef3de-a647-4196-b839-04f6ec964270 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:04:25.264147 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d9d20139-c75a-4b68-8b17-d077c9710627 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.356346 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d9d20139-c75a-4b68-8b17-d077c9710627 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.367091 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-d9d20139-c75a-4b68-8b17-d077c9710627 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['42a712e0-c504-45f6-a772-96f7157e5bc3']}} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:25.378070 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-d9d20139-c75a-4b68-8b17-d077c9710627 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b4bbb67e-00c9-4060-91ed-752e106d3acb') {'for_net_delete': True} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:25.378379 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-d9d20139-c75a-4b68-8b17-d077c9710627 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b4bbb67e-00c9-4060-91ed-752e106d3acb') {} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:25.387317 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d9d20139-c75a-4b68-8b17-d077c9710627 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8197639'] for segment, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.401439 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d9d20139-c75a-4b68-8b17-d077c9710627 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.408148 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d9d20139-c75a-4b68-8b17-d077c9710627 admin admin] Releasing vlan 516 on physical network physnet1 to pool {{(pid=93835) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 17:04:25.408686 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d9d20139-c75a-4b68-8b17-d077c9710627 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7342797'] for segment, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: Traceback (most recent call last): Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: timer() Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: cb(*args, **kw) Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: return func(*args, **kwargs) Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: self._notify() Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: self.callback(batched_events) Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: event.method(event) Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: return f(self, *a, **k) Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._get(url).json() Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: return self.request(url, 'GET', **kwargs) Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 17:04:25.410734 dv-cinder-799668-16-iscsi neutron-server[93835]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 17:04:25.474580 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d9d20139-c75a-4b68-8b17-d077c9710627 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.479471 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-d9d20139-c75a-4b68-8b17-d077c9710627 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.481567 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-d9d20139-c75a-4b68-8b17-d077c9710627 admin admin] 10.222.0.67 "DELETE /v2.0/networks/42a712e0-c504-45f6-a772-96f7157e5bc3 HTTP/1.1" status: 204 len: 168 time: 0.2846863 Sep 01 17:04:25.496602 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9d20139-c75a-4b68-8b17-d077c9710627 admin admin] Pushing event deleted for resources: {'Network': ['ID=42a712e0-c504-45f6-a772-96f7157e5bc3,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:25.570894 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-4e714db7-e62c-43ea-83c4-1b745b66c779 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1200574755&fields=id&tenant_id=63c213b6da7541a0ba2b290c5e15fe03 HTTP/1.1" status: 200 len: 267 time: 0.0399528 Sep 01 17:04:25.648501 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60024) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:04:25.682386 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-799d7055-95c5-404c-aa13-2dc37e9e8652 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:25.683868 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-799d7055-95c5-404c-aa13-2dc37e9e8652 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 811 time: 0.1063633 Sep 01 17:04:25.688870 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-3b5ddf96-22dc-4e81-847f-5caf0b2aa1af admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=0bbcb858ecfd4ebf8ddcdb3f0ee0ca35&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0388792 Sep 01 17:04:25.691150 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60026) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:04:25.700513 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-9305620f-89b8-4361-b5b0-912578d1b410 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/quotas/63c213b6da7541a0ba2b290c5e15fe03 HTTP/1.1" status: 200 len: 375 time: 0.0101640 Sep 01 17:04:25.741306 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cb126492-632f-48dc-a9c2-25fc4d45e790 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.757370 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-206aa019-34b3-40c8-8fb0-d61387881871 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0500536 Sep 01 17:04:25.761978 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cb126492-632f-48dc-a9c2-25fc4d45e790 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.809712 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cb126492-632f-48dc-a9c2-25fc4d45e790 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.812355 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-cb126492-632f-48dc-a9c2-25fc4d45e790 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:25.813579 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-cb126492-632f-48dc-a9c2-25fc4d45e790 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/adab84f7-bdb1-4f3f-865d-d1b646c5f335 HTTP/1.1" status: 204 len: 168 time: 0.1214027 Sep 01 17:04:25.821635 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb126492-632f-48dc-a9c2-25fc4d45e790 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=adab84f7-bdb1-4f3f-865d-d1b646c5f335,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:25.860721 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-1adcd70c-2b4d-4e96-9b5f-ab73cd78b1ad service neutron] 10.222.0.67 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0912466 Sep 01 17:04:25.951763 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-67dacb48-28c7-4229-9a6f-e6d93707dbc0 service neutron] 10.222.0.67 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850904 Sep 01 17:04:26.253004 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-468c25b7-1b2a-4426-b987-a5b70841479a req-4f4857bc-6621-46c0-9166-7cd305cfd918 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 210 time: 0.0304508 Sep 01 17:04:26.551893 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:26.597707 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:27.165151 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-75cb2e50-cb6b-43a7-882b-722883ffd271 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:27.166667 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-75cb2e50-cb6b-43a7-882b-722883ffd271 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 811 time: 0.1073105 Sep 01 17:04:27.212936 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-7bc829c0-8989-48fa-a336-c4118d0e1341 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=63c213b6da7541a0ba2b290c5e15fe03 HTTP/1.1" status: 200 len: 380 time: 0.0366166 Sep 01 17:04:27.225026 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-250bcad8-cbf1-4662-9fda-ae42cc2a9fe2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Request body: {'port': {'device_id': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'admin_state_up': True, 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'security_groups': ['8ded1df8-6989-4db0-876f-79e2a5cfe05e']}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:04:27.333954 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-250bcad8-cbf1-4662-9fda-ae42cc2a9fe2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Made reservation on behalf of 63c213b6da7541a0ba2b290c5e15fe03 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:04:27.337704 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-250bcad8-cbf1-4662-9fda-ae42cc2a9fe2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:27.349798 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-35cda671-85ac-41df-89b6-ed50dcad132f req-508d7279-0451-40d6-ab10-31285921e41c tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 210 time: 0.0289810 Sep 01 17:04:27.470649 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-250bcad8-cbf1-4662-9fda-ae42cc2a9fe2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Allocated IP 172.20.0.13 (35c995f2-96ec-4a35-9f59-05221a09df3f/ab89c120-a892-4afa-a645-bf3caf534f7c/71676e7c-69ca-4cba-8a82-4673e0fb57c6) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:04:27.613306 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-250bcad8-cbf1-4662-9fda-ae42cc2a9fe2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:27.628864 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-250bcad8-cbf1-4662-9fda-ae42cc2a9fe2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Transition to ACTIVE for port object 71676e7c-69ca-4cba-8a82-4673e0fb57c6 will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:04:27.663871 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-250bcad8-cbf1-4662-9fda-ae42cc2a9fe2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:27.704248 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-250bcad8-cbf1-4662-9fda-ae42cc2a9fe2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Network 35c995f2-96ec-4a35-9f59-05221a09df3f is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:04:27.709161 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-250bcad8-cbf1-4662-9fda-ae42cc2a9fe2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:04:27.712830 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-250bcad8-cbf1-4662-9fda-ae42cc2a9fe2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:04:27.743228 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-250bcad8-cbf1-4662-9fda-ae42cc2a9fe2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'Port': ['ID=71676e7c-69ca-4cba-8a82-4673e0fb57c6,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:27.767184 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-250bcad8-cbf1-4662-9fda-ae42cc2a9fe2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:27.767824 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-250bcad8-cbf1-4662-9fda-ae42cc2a9fe2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:27.783611 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-250bcad8-cbf1-4662-9fda-ae42cc2a9fe2 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5621994 Sep 01 17:04:27.796417 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Request body: {'port': {'device_id': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:04:27.857333 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:27.937973 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-867c781b-d8a8-446c-8792-37c4c7979df8 None None] Provisioning for port 71676e7c-69ca-4cba-8a82-4673e0fb57c6 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:04:27.941848 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-867c781b-d8a8-446c-8792-37c4c7979df8 None None] Provisioning complete for port 71676e7c-69ca-4cba-8a82-4673e0fb57c6 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:04:27.942224 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-867c781b-d8a8-446c-8792-37c4c7979df8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:27.979106 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-867c781b-d8a8-446c-8792-37c4c7979df8 None None] Port 71676e7c-69ca-4cba-8a82-4673e0fb57c6 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:04:28.118353 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 71676e7c-69ca-4cba-8a82-4673e0fb57c6 {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:04:28.126505 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:28.138172 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Transition to ACTIVE for port object 71676e7c-69ca-4cba-8a82-4673e0fb57c6 will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:04:28.142691 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:28.216331 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Pushing event updated for resources: {'Port': ['ID=71676e7c-69ca-4cba-8a82-4673e0fb57c6,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:28.268960 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Attempting to bind port 71676e7c-69ca-4cba-8a82-4673e0fb57c6 on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:04:28.269511 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Attempting to bind port 71676e7c-69ca-4cba-8a82-4673e0fb57c6 by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:04:28.269878 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Attempting to bind port 71676e7c-69ca-4cba-8a82-4673e0fb57c6 on network 35c995f2-96ec-4a35-9f59-05221a09df3f {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:04:28.274388 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Port 71676e7c-69ca-4cba-8a82-4673e0fb57c6 on network 35c995f2-96ec-4a35-9f59-05221a09df3f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:04:28.274715 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Attempting to bind port 71676e7c-69ca-4cba-8a82-4673e0fb57c6 on network 35c995f2-96ec-4a35-9f59-05221a09df3f {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:04:28.279889 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 4, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:04:28.280262 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Checking segment: {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:04:28.280650 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Bound using segment: {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:04:28.281082 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Bound port: 71676e7c-69ca-4cba-8a82-4673e0fb57c6, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:04:28.281975 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:28.347644 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] For port 71676e7c-69ca-4cba-8a82-4673e0fb57c6, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:04:28.350634 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] For port 71676e7c-69ca-4cba-8a82-4673e0fb57c6, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=71676e7c-69ca-4cba-8a82-4673e0fb57c6,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:04:28.354741 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:28.387071 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:28.387686 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:28.389123 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] 10.222.0.69 "PUT /v2.0/ports/71676e7c-69ca-4cba-8a82-4673e0fb57c6 HTTP/1.1" status: 200 len: 1094 time: 0.5975559 Sep 01 17:04:28.389543 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'tag': '71676e7c-69ca-4cba-8a82-4673e0fb57c6'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:04:28.391834 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c8b3af8-e081-406e-acda-ab6fc3eb1889" -d '{"events": [{"name": "network-changed", "server_uuid": "193e9c06-bfdd-491e-ac1b-fd70c1d8d243", "tag": "71676e7c-69ca-4cba-8a82-4673e0fb57c6"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:04:28.448742 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:04:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6221f9af-18cf-4fb7-bdcc-54748d92aa6d x-openstack-request-id: req-6221f9af-18cf-4fb7-bdcc-54748d92aa6d {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:04:28.449039 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "193e9c06-bfdd-491e-ac1b-fd70c1d8d243", "tag": "71676e7c-69ca-4cba-8a82-4673e0fb57c6", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:04:28.449287 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-6221f9af-18cf-4fb7-bdcc-54748d92aa6d {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:04:28.449697 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'tag': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'status': 'completed', 'code': 200} Sep 01 17:04:28.481998 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5ac93e2-6998-4329-a91e-e67c60d293bc service neutron] Pushing event updated for resources: {'Port': ['ID=71676e7c-69ca-4cba-8a82-4673e0fb57c6,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:28.485771 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-136f1b01-de4e-4246-be44-195d967cff09 req-ae63c2fc-9bf2-44ad-a0fe-01ca931bea3f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:28.487339 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-136f1b01-de4e-4246-be44-195d967cff09 req-ae63c2fc-9bf2-44ad-a0fe-01ca931bea3f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 944 time: 0.0583034 Sep 01 17:04:28.498132 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-3b53f5c5-f5b4-4f49-b52d-0c94ecd8dccb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:28.499653 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-3b53f5c5-f5b4-4f49-b52d-0c94ecd8dccb service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 1097 time: 0.0527301 Sep 01 17:04:28.530535 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-136f1b01-de4e-4246-be44-195d967cff09 req-e598e519-1629-4c8e-95b4-cc34b95b3726 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0360477 Sep 01 17:04:28.544921 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-e4ce2503-4a42-4f1d-b5d9-87adb64b7cf2 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=71676e7c-69ca-4cba-8a82-4673e0fb57c6 HTTP/1.1" status: 200 len: 217 time: 0.0361052 Sep 01 17:04:28.602518 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-0f50774f-3b6a-44fd-b6a7-88563286b55a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:28.603765 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-0f50774f-3b6a-44fd-b6a7-88563286b55a service neutron] 10.222.0.69 "GET /v2.0/subnets?id=ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 200 len: 850 time: 0.0506506 Sep 01 17:04:28.658634 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-93ef0493-e685-4db0-bb6c-b308722a780d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:28.660054 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-93ef0493-e685-4db0-bb6c-b308722a780d service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=35c995f2-96ec-4a35-9f59-05221a09df3f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0454655 Sep 01 17:04:28.756616 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-865385e4-4286-4635-b12e-d3031be7b4df service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830839 Sep 01 17:04:28.857666 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-3f7f34bc-6f4a-4ac8-bfc3-c61bec92abdb req-ccc4cc8c-95a3-4f03-b98c-1b5ad39ffec0 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861633 Sep 01 17:04:28.946926 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c8b3af8-e081-406e-acda-ab6fc3eb1889 req-7ed3a003-14f6-48e7-84be-8c045887d638 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:28.948351 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2c8b3af8-e081-406e-acda-ab6fc3eb1889 req-7ed3a003-14f6-48e7-84be-8c045887d638 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 1097 time: 0.0416331 Sep 01 17:04:29.043704 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c8b3af8-e081-406e-acda-ab6fc3eb1889 req-60249772-abb8-4608-a152-6105dd038b1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:29.045213 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2c8b3af8-e081-406e-acda-ab6fc3eb1889 req-60249772-abb8-4608-a152-6105dd038b1a service neutron] 10.222.0.69 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 912 time: 0.0860322 Sep 01 17:04:29.101159 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2c8b3af8-e081-406e-acda-ab6fc3eb1889 req-4e97c363-e99e-4a91-8431-b78517cd12e3 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=71676e7c-69ca-4cba-8a82-4673e0fb57c6 HTTP/1.1" status: 200 len: 217 time: 0.0400178 Sep 01 17:04:29.152622 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c8b3af8-e081-406e-acda-ab6fc3eb1889 req-80a388fa-07c0-4d36-99a6-2fee091b1c56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:29.154262 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2c8b3af8-e081-406e-acda-ab6fc3eb1889 req-80a388fa-07c0-4d36-99a6-2fee091b1c56 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 200 len: 850 time: 0.0460594 Sep 01 17:04:29.201823 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c8b3af8-e081-406e-acda-ab6fc3eb1889 req-17e73b34-a64d-4b52-9366-ba3df93bdc24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:29.203226 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2c8b3af8-e081-406e-acda-ab6fc3eb1889 req-17e73b34-a64d-4b52-9366-ba3df93bdc24 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=35c995f2-96ec-4a35-9f59-05221a09df3f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0413368 Sep 01 17:04:29.302574 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2c8b3af8-e081-406e-acda-ab6fc3eb1889 req-f4bdc898-2438-41d1-a925-897c4b28825d service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0916605 Sep 01 17:04:29.399110 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2c8b3af8-e081-406e-acda-ab6fc3eb1889 req-7e0edcdf-8f0e-4e21-9b23-531462a9e52d service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887547 Sep 01 17:04:29.417230 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdd5ad77-f968-4ffc-a558-e53d4427a76f req-03344800-7933-41b7-8a2e-b47d87aa1cb4 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:29.418727 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bdd5ad77-f968-4ffc-a558-e53d4427a76f req-03344800-7933-41b7-8a2e-b47d87aa1cb4 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0506499 Sep 01 17:04:29.459299 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bdd5ad77-f968-4ffc-a558-e53d4427a76f req-37354f69-88ea-4931-9237-0b311d3606cd tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0334995 Sep 01 17:04:29.651451 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e6c27c-96d6-444e-b624-06a8dac84378 req-fd643470-bb6d-453c-9054-dc07a4c1f75f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:29.652910 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-15e6c27c-96d6-444e-b624-06a8dac84378 req-fd643470-bb6d-453c-9054-dc07a4c1f75f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 944 time: 0.0522082 Sep 01 17:04:29.692176 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-15e6c27c-96d6-444e-b624-06a8dac84378 req-d25b9ffc-5d53-48cc-95e5-3892a43eb7da tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0323195 Sep 01 17:04:30.520435 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29111cc3-7b1f-47a9-bddf-0971706bfc97 req-fbc3ee37-5e94-47aa-b7da-06dcc68f1dcb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:30.522014 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-29111cc3-7b1f-47a9-bddf-0971706bfc97 req-fbc3ee37-5e94-47aa-b7da-06dcc68f1dcb service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 1098 time: 0.0424845 Sep 01 17:04:30.577507 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0561e7cf-1e1a-4f9b-8952-7e7bbc75a017 req-a441f1af-f5dc-4035-9194-56e9ebc0f304 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:30.579599 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0561e7cf-1e1a-4f9b-8952-7e7bbc75a017 req-a441f1af-f5dc-4035-9194-56e9ebc0f304 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0493529 Sep 01 17:04:30.618115 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0561e7cf-1e1a-4f9b-8952-7e7bbc75a017 req-2b7d558b-ad6a-4956-bc99-b357eb1b866e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0324538 Sep 01 17:04:30.633915 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29111cc3-7b1f-47a9-bddf-0971706bfc97 req-5c9c47ae-f4fa-4a01-92fd-d3fa10534937 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:30.635735 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-29111cc3-7b1f-47a9-bddf-0971706bfc97 req-5c9c47ae-f4fa-4a01-92fd-d3fa10534937 service neutron] 10.222.0.69 "GET /v2.0/networks?id=2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 200 len: 917 time: 0.0917633 Sep 01 17:04:30.701625 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-29111cc3-7b1f-47a9-bddf-0971706bfc97 req-3f1bc284-4451-4af8-8d96-209afaa3c314 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c335b865-32be-49e5-9765-66a2bc067d1e HTTP/1.1" status: 200 len: 1001 time: 0.0583045 Sep 01 17:04:30.760632 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29111cc3-7b1f-47a9-bddf-0971706bfc97 req-3b42e741-b307-4909-bc34-d04e036ecdc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:30.762153 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-29111cc3-7b1f-47a9-bddf-0971706bfc97 req-3b42e741-b307-4909-bc34-d04e036ecdc9 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=58fe425a-6b3e-47bd-b5c0-e68ea7782780 HTTP/1.1" status: 200 len: 855 time: 0.0507007 Sep 01 17:04:30.806053 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b13aa28f-b1e7-4a02-9881-edfe243705ee req-74fb8c68-5f07-4b78-ae0a-a4f739897de6 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:30.807543 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b13aa28f-b1e7-4a02-9881-edfe243705ee req-74fb8c68-5f07-4b78-ae0a-a4f739897de6 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 944 time: 0.0489037 Sep 01 17:04:30.810005 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29111cc3-7b1f-47a9-bddf-0971706bfc97 req-211564a4-46cb-42d4-859c-f976535bf0d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:30.811523 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-29111cc3-7b1f-47a9-bddf-0971706bfc97 req-211564a4-46cb-42d4-859c-f976535bf0d3 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2f7bfe5e-0012-467f-ad7f-aea2467233ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0409057 Sep 01 17:04:30.845076 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b13aa28f-b1e7-4a02-9881-edfe243705ee req-ed7622f5-c44b-4dc4-bee2-b40a04d7af49 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0311122 Sep 01 17:04:30.902924 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-29111cc3-7b1f-47a9-bddf-0971706bfc97 req-17cf12f4-c63c-45e7-be97-5f1663042c19 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829310 Sep 01 17:04:30.996395 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-29111cc3-7b1f-47a9-bddf-0971706bfc97 req-f5248511-2cb3-43c7-a1e4-9d7a5625796e service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857284 Sep 01 17:04:31.740615 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe08e670-ff3b-4bc6-968f-336f74c91ef5 req-8d9cc5aa-33a0-4a22-b7f3-a38110d2dbc6 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:31.742148 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fe08e670-ff3b-4bc6-968f-336f74c91ef5 req-8d9cc5aa-33a0-4a22-b7f3-a38110d2dbc6 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0521839 Sep 01 17:04:31.778756 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fe08e670-ff3b-4bc6-968f-336f74c91ef5 req-2b9c9cb5-8c6e-41ef-8c32-21d853b633da tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0308111 Sep 01 17:04:31.959705 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38b06c62-f2e3-4570-888f-1dfdc4f3a407 req-5ba10fea-37fb-4a1f-b2c0-8995922ff9ef tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:31.961071 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-38b06c62-f2e3-4570-888f-1dfdc4f3a407 req-5ba10fea-37fb-4a1f-b2c0-8995922ff9ef tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 944 time: 0.0481198 Sep 01 17:04:31.998319 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-38b06c62-f2e3-4570-888f-1dfdc4f3a407 req-871731dc-c1e7-4901-bdc9-d0c1fa744d45 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0313587 Sep 01 17:04:32.894526 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d54bd9a-a6c2-4a77-8d98-d7e112150702 req-c723b751-5ed9-4f0a-952a-6ce51551ff28 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:32.896010 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8d54bd9a-a6c2-4a77-8d98-d7e112150702 req-c723b751-5ed9-4f0a-952a-6ce51551ff28 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0482354 Sep 01 17:04:32.933177 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8d54bd9a-a6c2-4a77-8d98-d7e112150702 req-7356caf7-7e80-48c2-8261-20968c2ea60d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310628 Sep 01 17:04:33.112634 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03434ebd-d3ab-486b-8982-c25a7dc16dad req-23f1b806-4da0-47c1-adfb-f3c6a7d1b6c3 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:33.114050 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-03434ebd-d3ab-486b-8982-c25a7dc16dad req-23f1b806-4da0-47c1-adfb-f3c6a7d1b6c3 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 944 time: 0.0517647 Sep 01 17:04:33.150627 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-03434ebd-d3ab-486b-8982-c25a7dc16dad req-26a17898-4eb2-4b6e-9367-11baa06347d6 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0307193 Sep 01 17:04:34.051590 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f261ea54-89b5-4794-86a2-fca539dd849d req-1a44b451-eae9-401a-9459-d310f9d264bf tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:34.053082 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f261ea54-89b5-4794-86a2-fca539dd849d req-1a44b451-eae9-401a-9459-d310f9d264bf tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0493662 Sep 01 17:04:34.090357 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f261ea54-89b5-4794-86a2-fca539dd849d req-3b58f8a9-97d5-4f21-8558-aec5d5c6042c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314627 Sep 01 17:04:34.259918 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e100543d-cd2d-48bc-bc35-88fa849b70f4 req-d9fb72b1-3715-4b97-88af-b6971cbd688d tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:34.261280 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e100543d-cd2d-48bc-bc35-88fa849b70f4 req-d9fb72b1-3715-4b97-88af-b6971cbd688d tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 944 time: 0.0476618 Sep 01 17:04:34.298776 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e100543d-cd2d-48bc-bc35-88fa849b70f4 req-8c8be000-e5d2-4f83-bd77-28b1d5557f27 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0311687 Sep 01 17:04:34.839531 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 71676e7c-69ca-4cba-8a82-4673e0fb57c6 details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:04:34.930804 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 71676e7c-69ca-4cba-8a82-4673e0fb57c6, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=71676e7c-69ca-4cba-8a82-4673e0fb57c6,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:04:34.942109 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'port_id': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'mac_address': 'fa:16:3e:43:d9:90', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 511, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:04:34.980904 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:34.993034 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 71676e7c-69ca-4cba-8a82-4673e0fb57c6 {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:04:35.013580 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 71676e7c-69ca-4cba-8a82-4673e0fb57c6, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=71676e7c-69ca-4cba-8a82-4673e0fb57c6,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:04:35.018979 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:35.067316 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=71676e7c-69ca-4cba-8a82-4673e0fb57c6,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:35.210370 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74769fa6-1f13-4284-83ac-ba34d8fc302d req-1daeb514-1bba-4268-bbc3-da81127d1dfd tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:35.211842 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-74769fa6-1f13-4284-83ac-ba34d8fc302d req-1daeb514-1bba-4268-bbc3-da81127d1dfd tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0517073 Sep 01 17:04:35.248114 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-74769fa6-1f13-4284-83ac-ba34d8fc302d req-fb70f75d-ed60-48c1-8248-2dd617a722bf tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0303762 Sep 01 17:04:35.280953 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['71676e7c-69ca-4cba-8a82-4673e0fb57c6'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:04:35.411321 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e847df54-ed8e-417e-9274-044b4fe7276d req-543dac51-e269-40bd-a351-ddc077b4e2eb tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:35.412730 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e847df54-ed8e-417e-9274-044b4fe7276d req-543dac51-e269-40bd-a351-ddc077b4e2eb tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 945 time: 0.0488775 Sep 01 17:04:35.451027 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e847df54-ed8e-417e-9274-044b4fe7276d req-b3b23280-3742-47ca-a539-966514193f2b tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320873 Sep 01 17:04:36.367367 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bd9be8-304f-454f-8bf1-8de12153bf76 req-f61f89ed-a0b2-49aa-a5ca-4cc8e33665d8 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:36.368857 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-13bd9be8-304f-454f-8bf1-8de12153bf76 req-f61f89ed-a0b2-49aa-a5ca-4cc8e33665d8 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0493579 Sep 01 17:04:36.407526 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-13bd9be8-304f-454f-8bf1-8de12153bf76 req-256fad90-27c5-49f0-9abd-7b6f076785cd tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0328066 Sep 01 17:04:36.565956 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6783e014-596d-4ee3-bf31-cf7ada1faa82 req-3d196a6b-7966-42d7-b615-a9ce06999ba1 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:36.567450 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6783e014-596d-4ee3-bf31-cf7ada1faa82 req-3d196a6b-7966-42d7-b615-a9ce06999ba1 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 945 time: 0.0521748 Sep 01 17:04:36.603924 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6783e014-596d-4ee3-bf31-cf7ada1faa82 req-a52d54cd-7370-4418-9f8c-2ddaa83fb2cc tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0307093 Sep 01 17:04:36.865175 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 71676e7c-69ca-4cba-8a82-4673e0fb57c6 up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:04:36.912563 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port 71676e7c-69ca-4cba-8a82-4673e0fb57c6 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:04:36.916212 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port 71676e7c-69ca-4cba-8a82-4673e0fb57c6 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:04:36.916580 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:36.994657 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:37.017905 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '71676e7c-69ca-4cba-8a82-4673e0fb57c6'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:04:37.020122 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-49723475-7b20-4bf7-b7d9-f2542938a30e" -d '{"events": [{"server_uuid": "193e9c06-bfdd-491e-ac1b-fd70c1d8d243", "name": "network-vif-plugged", "status": "completed", "tag": "71676e7c-69ca-4cba-8a82-4673e0fb57c6"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:04:37.033111 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port 71676e7c-69ca-4cba-8a82-4673e0fb57c6, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=71676e7c-69ca-4cba-8a82-4673e0fb57c6,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:04:37.039886 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:37.063775 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:04:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7a7333a3-e257-4c91-a1c4-e6add6d16021 x-openstack-request-id: req-7a7333a3-e257-4c91-a1c4-e6add6d16021 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:04:37.063961 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "193e9c06-bfdd-491e-ac1b-fd70c1d8d243", "name": "network-vif-plugged", "status": "completed", "tag": "71676e7c-69ca-4cba-8a82-4673e0fb57c6", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:04:37.064169 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-7a7333a3-e257-4c91-a1c4-e6add6d16021 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:04:37.064555 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'code': 200} Sep 01 17:04:37.089807 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=71676e7c-69ca-4cba-8a82-4673e0fb57c6,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:37.292713 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cfb3467-fd56-45fa-a53f-b39c9d15a2d2 req-3123b8bc-6da3-445c-b251-730d41a61eb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:37.294309 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7cfb3467-fd56-45fa-a53f-b39c9d15a2d2 req-3123b8bc-6da3-445c-b251-730d41a61eb9 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 1099 time: 0.0414808 Sep 01 17:04:37.330215 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7cfb3467-fd56-45fa-a53f-b39c9d15a2d2 req-492c02d9-491f-4fbc-8e7c-9c86d92c7da4 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0280051 Sep 01 17:04:37.523741 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-018fc252-48af-423a-99f2-34de5a4b8ff9 req-9671a765-940e-42d1-b1c7-af93d1d831f7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:37.525222 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-018fc252-48af-423a-99f2-34de5a4b8ff9 req-9671a765-940e-42d1-b1c7-af93d1d831f7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0479965 Sep 01 17:04:37.563460 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-018fc252-48af-423a-99f2-34de5a4b8ff9 req-92e14761-10b8-49ab-920c-b07a4daa2a0d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0319660 Sep 01 17:04:37.721183 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44450b19-5bae-4acd-baa3-409423333579 req-cfd8714f-3cb9-4a85-bf41-37ebb338880d tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:37.722697 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-44450b19-5bae-4acd-baa3-409423333579 req-cfd8714f-3cb9-4a85-bf41-37ebb338880d tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 946 time: 0.0528443 Sep 01 17:04:37.762718 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-44450b19-5bae-4acd-baa3-409423333579 req-8565ea12-8179-48cf-b965-ce47d45c6561 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0309641 Sep 01 17:04:38.586980 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:04:38.683042 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bb4775a-0fd9-41f2-a18a-cb546d7d4f78 req-043a68b3-d3a7-4f52-8fc7-60b97efa8122 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:38.684493 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4bb4775a-0fd9-41f2-a18a-cb546d7d4f78 req-043a68b3-d3a7-4f52-8fc7-60b97efa8122 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0516682 Sep 01 17:04:38.720924 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4bb4775a-0fd9-41f2-a18a-cb546d7d4f78 req-8849cd08-e2d5-4cc6-bfd2-f5951ad53d7a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0304000 Sep 01 17:04:38.873774 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be690e43-c967-4318-a323-3e54d6c42705 req-a879976f-7cfa-4196-b59d-88e26fe5cc21 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:38.875815 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-be690e43-c967-4318-a323-3e54d6c42705 req-a879976f-7cfa-4196-b59d-88e26fe5cc21 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 946 time: 0.0487010 Sep 01 17:04:38.913075 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-be690e43-c967-4318-a323-3e54d6c42705 req-12b2cd24-f67e-4936-8bad-c0564c6e23ad tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314050 Sep 01 17:04:39.025574 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4331d803-a6ce-42b6-83b3-8d5bffe5a127 req-7eaf08ac-a4f2-4f85-bc9c-b5456a9d21b5 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:39.027310 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4331d803-a6ce-42b6-83b3-8d5bffe5a127 req-7eaf08ac-a4f2-4f85-bc9c-b5456a9d21b5 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 946 time: 0.0485857 Sep 01 17:04:39.066916 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4331d803-a6ce-42b6-83b3-8d5bffe5a127 req-7b86ceff-be89-4340-91ae-a1b979a460ef tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0329542 Sep 01 17:04:39.088447 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60108) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:04:39.131170 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87727b7c-64e8-4ab1-8ff7-a1e14e145492 tempest-TestVolumeBootPattern-345519433 tempest-TestVolumeBootPattern-345519433-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:39.132653 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-87727b7c-64e8-4ab1-8ff7-a1e14e145492 tempest-TestVolumeBootPattern-345519433 tempest-TestVolumeBootPattern-345519433-project-admin] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 1094 time: 0.0432746 Sep 01 17:04:39.135451 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60110) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:04:39.139647 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Request body: {'floatingip': {'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'port_id': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address': '172.20.0.13'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:04:39.160702 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for floatingip, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:39.253080 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:39.358980 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Allocated IP 172.27.1.141 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/0adf1b8c-eaef-467e-b61f-5318d84457da) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:04:39.457630 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:39.495859 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:39.538588 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:04:39.543053 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:04:39.547978 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:04:39.549954 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'Port': ['ID=0adf1b8c-eaef-467e-b61f-5318d84457da,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:39.884709 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3c15b6-8df9-40c6-8e3a-7d70ffccb285 req-c9082ab8-3ddf-4f8a-a0a0-9dc2ed984817 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:39.886193 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4f3c15b6-8df9-40c6-8e3a-7d70ffccb285 req-c9082ab8-3ddf-4f8a-a0a0-9dc2ed984817 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0920608 Sep 01 17:04:39.952569 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4f3c15b6-8df9-40c6-8e3a-7d70ffccb285 req-0c3e496f-62a7-4eb2-a449-8230b392fff3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0594504 Sep 01 17:04:39.959252 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:40.027968 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:40.175828 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for port, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:40.180385 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6279726'] for port, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:40.249094 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'Port': ['ID=0adf1b8c-eaef-467e-b61f-5318d84457da,revision_number=2']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:04:40.259412 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:40.352684 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.l3_db [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Floating IP 9a981a6e-2c7d-4c4d-b4cc-f601ed27b585 associated. External IP: 172.27.1.141, port: 71676e7c-69ca-4cba-8a82-4673e0fb57c6. Sep 01 17:04:40.552668 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:04:40.657042 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:04:40.666335 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bbce36e-fd83-4455-8ea7-b7d001a9a93c None None] Sync routers for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:04:40.673604 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:40.677628 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bbce36e-fd83-4455-8ea7-b7d001a9a93c None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:04:40.678259 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-6bbce36e-fd83-4455-8ea7-b7d001a9a93c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:04:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:40.701675 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-9bed1989-2d73-4595-9884-a13446dbdde9 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.5652144 Sep 01 17:04:40.702349 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'tag': '71676e7c-69ca-4cba-8a82-4673e0fb57c6'}] {{(pid=93836) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:04:40.704593 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}60a7e58791dd3a103db7a0d35103b09d0a4cb2c205e1177c181e158a6fe3866f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd9e8aa4-c69b-4d12-be3e-8f9ce24d153f" -d '{"events": [{"name": "network-changed", "server_uuid": "193e9c06-bfdd-491e-ac1b-fd70c1d8d243", "tag": "71676e7c-69ca-4cba-8a82-4673e0fb57c6"}]}' {{(pid=93836) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:04:40.788849 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-6bbce36e-fd83-4455-8ea7-b7d001a9a93c None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:04:40.917685 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:04:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d0ada812-3d50-4b32-a007-737bc9ae1ff6 x-openstack-request-id: req-d0ada812-3d50-4b32-a007-737bc9ae1ff6 {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:04:40.918186 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "193e9c06-bfdd-491e-ac1b-fd70c1d8d243", "tag": "71676e7c-69ca-4cba-8a82-4673e0fb57c6", "status": "completed", "code": 200}]} {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:04:40.918336 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-d0ada812-3d50-4b32-a007-737bc9ae1ff6 {{(pid=93836) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:04:40.918793 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'tag': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'status': 'completed', 'code': 200} Sep 01 17:04:40.983914 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9e8aa4-c69b-4d12-be3e-8f9ce24d153f req-71f3cbfd-fe17-4788-a4a3-111c48b3b6bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:40.985520 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd9e8aa4-c69b-4d12-be3e-8f9ce24d153f req-71f3cbfd-fe17-4788-a4a3-111c48b3b6bb service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 1099 time: 0.0441825 Sep 01 17:04:41.018918 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-6bbce36e-fd83-4455-8ea7-b7d001a9a93c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '9a981a6e-2c7d-4c4d-b4cc-f601ed27b585', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.141', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:43:d9:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:04:39Z', 'updated_at': '2021-09-01T17:04:39Z', 'revision_number': 0, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:41.046919 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bbce36e-fd83-4455-8ea7-b7d001a9a93c None None] Checking router: 8724afe3-ad3a-4d4f-94c4-4642b6e0afab for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:04:41.056504 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bbce36e-fd83-4455-8ea7-b7d001a9a93c None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:04:41.057129 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-6bbce36e-fd83-4455-8ea7-b7d001a9a93c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:04:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:41.082491 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad88ff11-4db5-4bb5-9a63-bad079fcdbe7 req-f95af3db-d2dc-47fc-aa16-f7ff885c66a3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:41.084049 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ad88ff11-4db5-4bb5-9a63-bad079fcdbe7 req-f95af3db-d2dc-47fc-aa16-f7ff885c66a3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0581462 Sep 01 17:04:41.087988 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9e8aa4-c69b-4d12-be3e-8f9ce24d153f req-c9741bae-a059-45a9-8c5e-8b5e9024e0a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:41.090380 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd9e8aa4-c69b-4d12-be3e-8f9ce24d153f req-c9741bae-a059-45a9-8c5e-8b5e9024e0a8 service neutron] 10.222.0.69 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 912 time: 0.0975595 Sep 01 17:04:41.123892 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ad88ff11-4db5-4bb5-9a63-bad079fcdbe7 req-d0364360-4f85-4776-9c45-772e996d3121 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0339022 Sep 01 17:04:41.170942 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-6bbce36e-fd83-4455-8ea7-b7d001a9a93c None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:04:41.310852 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd9e8aa4-c69b-4d12-be3e-8f9ce24d153f req-99f5766e-2c31-4591-8ffe-ab8f37742f41 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=71676e7c-69ca-4cba-8a82-4673e0fb57c6 HTTP/1.1" status: 200 len: 1000 time: 0.0640850 Sep 01 17:04:41.360435 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9e8aa4-c69b-4d12-be3e-8f9ce24d153f req-c6f99dd4-25d3-43bf-aed6-7458a44621de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:41.361965 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd9e8aa4-c69b-4d12-be3e-8f9ce24d153f req-c6f99dd4-25d3-43bf-aed6-7458a44621de service neutron] 10.222.0.69 "GET /v2.0/subnets?id=ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 200 len: 850 time: 0.0441239 Sep 01 17:04:41.396627 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-6bbce36e-fd83-4455-8ea7-b7d001a9a93c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '9a981a6e-2c7d-4c4d-b4cc-f601ed27b585', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.141', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:43:d9:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:04:39Z', 'updated_at': '2021-09-01T17:04:39Z', 'revision_number': 0, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:04:41.411466 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9e8aa4-c69b-4d12-be3e-8f9ce24d153f req-1990eb95-add7-40b2-88f5-d2bb10e61d4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:41.412985 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd9e8aa4-c69b-4d12-be3e-8f9ce24d153f req-1990eb95-add7-40b2-88f5-d2bb10e61d4b service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=35c995f2-96ec-4a35-9f59-05221a09df3f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0430350 Sep 01 17:04:41.426321 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bbce36e-fd83-4455-8ea7-b7d001a9a93c None None] The sync data for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi is: [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '9a981a6e-2c7d-4c4d-b4cc-f601ed27b585', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.141', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:43:d9:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:04:39Z', 'updated_at': '2021-09-01T17:04:39Z', 'revision_number': 0, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:04:41.510882 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd9e8aa4-c69b-4d12-be3e-8f9ce24d153f req-2713ac1b-c641-4c8c-9a17-de2175655efd service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0896494 Sep 01 17:04:41.607435 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-cd9e8aa4-c69b-4d12-be3e-8f9ce24d153f req-ade61b7f-fa86-4f29-9d7a-6c46da99fe46 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886204 Sep 01 17:04:41.610927 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a060a4c9-c3dc-4cf7-876c-3417e3c37e59 None None] New status for floating IP 9a981a6e-2c7d-4c4d-b4cc-f601ed27b585: ACTIVE {{(pid=93838) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:04:42.244486 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d45faead-41e0-48d4-8978-fec91f0b2b95 req-1f9b2756-3d78-46ed-bf8b-d97e4fd48686 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:42.245988 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d45faead-41e0-48d4-8978-fec91f0b2b95 req-1f9b2756-3d78-46ed-bf8b-d97e4fd48686 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0472219 Sep 01 17:04:42.283628 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d45faead-41e0-48d4-8978-fec91f0b2b95 req-79025284-4c2d-42e9-9740-c0626d8cbdb9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0307331 Sep 01 17:04:43.407569 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4c67b80-fc35-45d9-bf55-390fb16ee6bb req-eb92085c-90c4-45c8-b31f-a616a94b4c9d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:43.409045 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b4c67b80-fc35-45d9-bf55-390fb16ee6bb req-eb92085c-90c4-45c8-b31f-a616a94b4c9d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0521312 Sep 01 17:04:43.446416 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b4c67b80-fc35-45d9-bf55-390fb16ee6bb req-38e2b0b7-ee60-4c00-b20d-6b712c2f5385 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0313122 Sep 01 17:04:44.564088 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1fc9aae-3b51-4195-8902-f9b76c979841 req-3d344102-cb3e-4e86-95b9-c1955cd254d5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:44.565583 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f1fc9aae-3b51-4195-8902-f9b76c979841 req-3d344102-cb3e-4e86-95b9-c1955cd254d5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0480919 Sep 01 17:04:44.604476 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f1fc9aae-3b51-4195-8902-f9b76c979841 req-99077cdb-de2b-48b9-8ce9-3d0605ba1a38 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0331540 Sep 01 17:04:45.722704 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d22498e-4dd6-48fb-97c4-4ac22ede2f11 req-a1a22a0c-b4a9-4e45-9875-de6c4ffbd608 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:45.724176 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5d22498e-4dd6-48fb-97c4-4ac22ede2f11 req-a1a22a0c-b4a9-4e45-9875-de6c4ffbd608 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0489149 Sep 01 17:04:45.768296 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5d22498e-4dd6-48fb-97c4-4ac22ede2f11 req-1e1ab794-a46b-462e-b2bf-127d5c9fbbf3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0369184 Sep 01 17:04:46.884840 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8eb987d-e88e-4cef-876f-cc0015404233 req-6327e381-8456-4f36-b897-8ad8f0e854bb tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:46.886349 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d8eb987d-e88e-4cef-876f-cc0015404233 req-6327e381-8456-4f36-b897-8ad8f0e854bb tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0480442 Sep 01 17:04:46.923998 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d8eb987d-e88e-4cef-876f-cc0015404233 req-fc09601f-e566-4cd6-a7ed-524fd7e58ed8 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317798 Sep 01 17:04:48.040606 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f0e8291-eba4-4d00-a85d-cecb08e5351d req-380786e2-bc8c-407a-9976-47a82da778ad tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:48.042091 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0f0e8291-eba4-4d00-a85d-cecb08e5351d req-380786e2-bc8c-407a-9976-47a82da778ad tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0490906 Sep 01 17:04:48.090219 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0f0e8291-eba4-4d00-a85d-cecb08e5351d req-3771e9aa-2635-41db-b83f-64a002aab921 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415626 Sep 01 17:04:49.208613 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-556d8548-9a9e-4bc7-88c3-9236b2fdc600 req-f521d9d2-1f87-4207-ac97-ff3dae8cedd5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:49.210125 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-556d8548-9a9e-4bc7-88c3-9236b2fdc600 req-f521d9d2-1f87-4207-ac97-ff3dae8cedd5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0482709 Sep 01 17:04:49.246663 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-556d8548-9a9e-4bc7-88c3-9236b2fdc600 req-005c093d-7116-4776-9d2e-8ddf2a979372 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0307934 Sep 01 17:04:50.364122 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d7989e9-3efe-4cc2-a75a-535d68e3a3aa req-96279f4f-489c-4ea8-aa27-eccd3f8af838 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:50.365617 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0d7989e9-3efe-4cc2-a75a-535d68e3a3aa req-96279f4f-489c-4ea8-aa27-eccd3f8af838 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0480628 Sep 01 17:04:50.402615 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0d7989e9-3efe-4cc2-a75a-535d68e3a3aa req-182a0983-6ced-48ae-9962-c7525c19db8a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312028 Sep 01 17:04:51.241838 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-fe0d2cac-1ca4-4759-a8e1-9451b4a8d80e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:51.518659 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a6b51cb-bc49-41eb-9654-c19360aa2687 req-d495e886-9034-4d7f-9b97-919bd87d276e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:51.520119 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6a6b51cb-bc49-41eb-9654-c19360aa2687 req-d495e886-9034-4d7f-9b97-919bd87d276e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0484493 Sep 01 17:04:51.560469 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6a6b51cb-bc49-41eb-9654-c19360aa2687 req-b22b47cf-9332-45b5-a9ac-c7f4da0cc038 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0345106 Sep 01 17:04:52.677118 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f60ede8-e4e9-4235-b2a3-7b83574b0201 req-f461fcca-f0e3-4088-93b9-45b89e4f9da1 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:52.678625 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9f60ede8-e4e9-4235-b2a3-7b83574b0201 req-f461fcca-f0e3-4088-93b9-45b89e4f9da1 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0485692 Sep 01 17:04:52.715248 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9f60ede8-e4e9-4235-b2a3-7b83574b0201 req-0e8d849d-9e75-4437-a683-627d9adba1d6 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0307782 Sep 01 17:04:53.764594 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:53.781844 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-847e9d9a-a2ce-4416-bda5-0119a0a0a07b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:53.838895 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a232a5d-3500-423d-a1cd-76e6fe58553a req-0f238504-8222-4657-bbe3-ceca96fecc88 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:53.840331 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8a232a5d-3500-423d-a1cd-76e6fe58553a req-0f238504-8222-4657-bbe3-ceca96fecc88 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0487504 Sep 01 17:04:53.877700 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8a232a5d-3500-423d-a1cd-76e6fe58553a req-04a5e096-e75a-449b-be02-c61a0e048d7c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0311544 Sep 01 17:04:54.916536 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:54.998904 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7fe27b2-3260-4f91-9b8f-2aaa6328a260 req-bab26cb3-5ad2-4d62-be40-09e8dafa8e2a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:55.000520 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a7fe27b2-3260-4f91-9b8f-2aaa6328a260 req-bab26cb3-5ad2-4d62-be40-09e8dafa8e2a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0485435 Sep 01 17:04:55.041912 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a7fe27b2-3260-4f91-9b8f-2aaa6328a260 req-eb374362-c882-4c11-8438-63b7cf5d568a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0349033 Sep 01 17:04:56.163014 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea300a54-464a-432d-aacf-2d995f3e6b7a req-59b09965-4d79-482b-a399-202e799119d4 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:56.164815 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ea300a54-464a-432d-aacf-2d995f3e6b7a req-59b09965-4d79-482b-a399-202e799119d4 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0525055 Sep 01 17:04:56.204928 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ea300a54-464a-432d-aacf-2d995f3e6b7a req-ab3e2b6e-e73e-4287-9b7d-a2e523ae2e68 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0340164 Sep 01 17:04:56.554893 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:56.603140 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:04:57.327955 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70960352-b1b4-4987-bd28-e91da6c5a503 req-3d9d72b2-99aa-4af2-8b75-da55a5d84613 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:57.329367 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-70960352-b1b4-4987-bd28-e91da6c5a503 req-3d9d72b2-99aa-4af2-8b75-da55a5d84613 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0508499 Sep 01 17:04:57.372813 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-70960352-b1b4-4987-bd28-e91da6c5a503 req-583f712f-718b-4468-af30-6e47c7ee3a9c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0372918 Sep 01 17:04:58.503747 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8df6e8f5-52eb-435c-bdd3-c6bafc7032cd req-e61ffd82-297a-4e78-a609-cd056984d4d2 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:58.505379 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8df6e8f5-52eb-435c-bdd3-c6bafc7032cd req-e61ffd82-297a-4e78-a609-cd056984d4d2 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0486386 Sep 01 17:04:58.548494 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8df6e8f5-52eb-435c-bdd3-c6bafc7032cd req-05b661fb-a2db-442a-a504-5ecc943abf4f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0369098 Sep 01 17:04:59.668483 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6f7d099-e3a1-426d-80f2-e5c1131b6265 req-16948d6e-2930-4812-a8f1-1e215c00548b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:04:59.669984 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e6f7d099-e3a1-426d-80f2-e5c1131b6265 req-16948d6e-2930-4812-a8f1-1e215c00548b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0490725 Sep 01 17:04:59.708003 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e6f7d099-e3a1-426d-80f2-e5c1131b6265 req-f64a9c87-e57f-4b4e-bc38-7779fe6b7a5f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310564 Sep 01 17:05:00.828838 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790229d6-e666-446e-bf53-df6b8fc8c337 req-ca45728b-90f2-4f69-acd2-4c527531a558 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:00.830344 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-790229d6-e666-446e-bf53-df6b8fc8c337 req-ca45728b-90f2-4f69-acd2-4c527531a558 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0488219 Sep 01 17:05:00.868895 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-790229d6-e666-446e-bf53-df6b8fc8c337 req-c46d1390-5867-4d07-b90d-be0a77c694e6 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0324917 Sep 01 17:05:00.974524 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device c335b865-32be-49e5-9765-66a2bc067d1e details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:05:01.067663 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port c335b865-32be-49e5-9765-66a2bc067d1e, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=c335b865-32be-49e5-9765-66a2bc067d1e,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:05:01.082734 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'port_id': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'mac_address': 'fa:16:3e:96:5a:bf', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 544, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:05:01.119660 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:01.132334 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id c335b865-32be-49e5-9765-66a2bc067d1e {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:05:01.151866 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port c335b865-32be-49e5-9765-66a2bc067d1e, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=c335b865-32be-49e5-9765-66a2bc067d1e,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:05:01.156801 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:01.207974 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=c335b865-32be-49e5-9765-66a2bc067d1e,revision_number=6']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:05:01.246964 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['c335b865-32be-49e5-9765-66a2bc067d1e'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:05:01.989514 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e6eb0fd-3690-4171-987b-dbe564909237 req-bd674cc4-58ee-46ae-ae7d-141da220c57b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:01.990973 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7e6eb0fd-3690-4171-987b-dbe564909237 req-bd674cc4-58ee-46ae-ae7d-141da220c57b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 944 time: 0.0505166 Sep 01 17:05:02.031962 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7e6eb0fd-3690-4171-987b-dbe564909237 req-035918df-16a6-49b7-8741-fc46859bfc39 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0351732 Sep 01 17:05:02.989136 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device c335b865-32be-49e5-9765-66a2bc067d1e up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:05:03.038178 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port c335b865-32be-49e5-9765-66a2bc067d1e triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:05:03.038586 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:03.132797 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:03.161789 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c335b865-32be-49e5-9765-66a2bc067d1e'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:05:03.164092 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8487ae42-67b4-4fe0-b1b8-364f8962dec8" -d '{"events": [{"server_uuid": "5e792cf3-d84a-40f8-af00-f4e251c62ed8", "name": "network-vif-plugged", "status": "completed", "tag": "c335b865-32be-49e5-9765-66a2bc067d1e"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:05:03.185955 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f27092d-289b-45c6-b856-5d0ae1d34505 req-73b0f551-7889-4f97-bc98-fec39a00eda2 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:03.187728 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7f27092d-289b-45c6-b856-5d0ae1d34505 req-73b0f551-7889-4f97-bc98-fec39a00eda2 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 944 time: 0.0683880 Sep 01 17:05:03.201277 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port c335b865-32be-49e5-9765-66a2bc067d1e, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=c335b865-32be-49e5-9765-66a2bc067d1e,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:05:03.206820 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:03.238231 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:05:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-55cbb82c-6081-4f5b-a870-6c239959efdd x-openstack-request-id: req-55cbb82c-6081-4f5b-a870-6c239959efdd {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:05:03.238563 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5e792cf3-d84a-40f8-af00-f4e251c62ed8", "name": "network-vif-plugged", "status": "completed", "tag": "c335b865-32be-49e5-9765-66a2bc067d1e", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:05:03.238776 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-55cbb82c-6081-4f5b-a870-6c239959efdd {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:05:03.239229 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'code': 200} Sep 01 17:05:03.250625 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7f27092d-289b-45c6-b856-5d0ae1d34505 req-c3175262-cdfc-4b35-a475-0bf2a190aa7e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0521252 Sep 01 17:05:03.279844 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=c335b865-32be-49e5-9765-66a2bc067d1e,revision_number=7']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:05:04.379225 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98884117-44dd-4fd5-88a8-bd2bfbef147f req-0ae73b60-d99f-4b8d-ba81-ac032c67f4fe tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:04.381027 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-98884117-44dd-4fd5-88a8-bd2bfbef147f req-0ae73b60-d99f-4b8d-ba81-ac032c67f4fe tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0521448 Sep 01 17:05:04.423510 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-98884117-44dd-4fd5-88a8-bd2bfbef147f req-979b5244-9ccc-40ba-9fa0-caaa07430a64 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0359538 Sep 01 17:05:05.558470 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3f1d88e-af27-4b2b-ba51-5b471914684d req-7f219173-8d27-419c-97bb-a876429042c1 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:05.560140 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d3f1d88e-af27-4b2b-ba51-5b471914684d req-7f219173-8d27-419c-97bb-a876429042c1 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0525043 Sep 01 17:05:05.614666 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d3f1d88e-af27-4b2b-ba51-5b471914684d req-ceb81a69-9dfd-46eb-892b-a3ddfb65b08e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466928 Sep 01 17:05:06.745761 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4837c1b1-fe6c-408c-9b96-001acbc16e01 req-a2b22608-931b-4a2b-8d39-e5d611ef63b0 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:06.747392 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4837c1b1-fe6c-408c-9b96-001acbc16e01 req-a2b22608-931b-4a2b-8d39-e5d611ef63b0 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0532105 Sep 01 17:05:06.788193 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4837c1b1-fe6c-408c-9b96-001acbc16e01 req-ba959759-6975-446c-a601-8f2f02f3ac28 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0346646 Sep 01 17:05:07.926101 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c69a33a-c5d0-4c1b-b3e7-e100904cb351 req-8fe748e5-6ddd-4c48-accb-b3f27d8c3ba9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:07.927925 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3c69a33a-c5d0-4c1b-b3e7-e100904cb351 req-8fe748e5-6ddd-4c48-accb-b3f27d8c3ba9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0564208 Sep 01 17:05:07.995030 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3c69a33a-c5d0-4c1b-b3e7-e100904cb351 req-9374ce22-2ca0-4405-99c6-102e402d541b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0602970 Sep 01 17:05:09.130913 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45fdfbaa-3db3-4740-a577-88e17f21da13 req-8cca5b77-daa6-4be4-b7a3-1d7f11a8f589 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:09.132438 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-45fdfbaa-3db3-4740-a577-88e17f21da13 req-8cca5b77-daa6-4be4-b7a3-1d7f11a8f589 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0513284 Sep 01 17:05:09.176708 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-45fdfbaa-3db3-4740-a577-88e17f21da13 req-7aeec6ca-786d-4132-bce0-6ae71a17bfe3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380523 Sep 01 17:05:10.305661 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc95943-97a7-4d0a-9040-c33c60752bc4 req-724995c4-4fae-47d6-94f3-4abba724af63 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:10.314010 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bdc95943-97a7-4d0a-9040-c33c60752bc4 req-724995c4-4fae-47d6-94f3-4abba724af63 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0580869 Sep 01 17:05:10.349829 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bdc95943-97a7-4d0a-9040-c33c60752bc4 req-1b0b364b-42ba-4c44-9e65-4daca98d8a34 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0349030 Sep 01 17:05:11.474472 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be1d2bd8-f6b5-49a6-a3b0-e5bb17ba8529 req-51d5da42-c379-4006-91ae-fe762b731313 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:11.476068 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-be1d2bd8-f6b5-49a6-a3b0-e5bb17ba8529 req-51d5da42-c379-4006-91ae-fe762b731313 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0521493 Sep 01 17:05:11.519986 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-be1d2bd8-f6b5-49a6-a3b0-e5bb17ba8529 req-0070bcc2-0654-4d72-89ad-575973a81330 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377553 Sep 01 17:05:12.267301 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-983a581c-49c6-4e4d-8840-71972f75b4ff req-1b9ed886-5a5c-4771-b7ed-35d0cc553b04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:12.268791 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-983a581c-49c6-4e4d-8840-71972f75b4ff req-1b9ed886-5a5c-4771-b7ed-35d0cc553b04 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 1098 time: 0.0413907 Sep 01 17:05:12.367015 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-983a581c-49c6-4e4d-8840-71972f75b4ff req-0926ac2d-1485-40a3-8793-f17b4250397d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:12.368728 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-983a581c-49c6-4e4d-8840-71972f75b4ff req-0926ac2d-1485-40a3-8793-f17b4250397d service neutron] 10.222.0.69 "GET /v2.0/networks?id=2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 200 len: 917 time: 0.0915813 Sep 01 17:05:12.445104 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-983a581c-49c6-4e4d-8840-71972f75b4ff req-bfaec18d-f1ed-4336-b447-9ff9f0763c97 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c335b865-32be-49e5-9765-66a2bc067d1e HTTP/1.1" status: 200 len: 1001 time: 0.0664840 Sep 01 17:05:12.501129 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-983a581c-49c6-4e4d-8840-71972f75b4ff req-0b4348ff-ac0e-4d0f-863f-64d7b82d931c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:12.502577 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-983a581c-49c6-4e4d-8840-71972f75b4ff req-0b4348ff-ac0e-4d0f-863f-64d7b82d931c service neutron] 10.222.0.69 "GET /v2.0/subnets?id=58fe425a-6b3e-47bd-b5c0-e68ea7782780 HTTP/1.1" status: 200 len: 855 time: 0.0461495 Sep 01 17:05:12.548749 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-983a581c-49c6-4e4d-8840-71972f75b4ff req-d65fc632-6998-4f72-b8f5-eb860d44d081 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:12.550285 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-983a581c-49c6-4e4d-8840-71972f75b4ff req-d65fc632-6998-4f72-b8f5-eb860d44d081 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2f7bfe5e-0012-467f-ad7f-aea2467233ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0400171 Sep 01 17:05:12.637846 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c6551c6-db11-4a41-b9e8-a84efda36b61 req-0a1a35b6-32de-47b3-a09c-d14a310c2ba4 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:12.639228 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9c6551c6-db11-4a41-b9e8-a84efda36b61 req-0a1a35b6-32de-47b3-a09c-d14a310c2ba4 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0482681 Sep 01 17:05:12.639336 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-983a581c-49c6-4e4d-8840-71972f75b4ff req-7ec9009d-0a94-4f3d-a0e6-a177c8f868d0 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0817003 Sep 01 17:05:12.680629 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9c6551c6-db11-4a41-b9e8-a84efda36b61 req-01c7f177-041e-40f7-b86c-e1fc7f245e5b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0352516 Sep 01 17:05:12.740117 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-983a581c-49c6-4e4d-8840-71972f75b4ff req-0e26a5b3-b3cf-4aa5-a774-9e35ae800c72 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882421 Sep 01 17:05:13.798337 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae49e5bc-f977-4ad3-811b-235de287424e req-9ca40533-c771-4d99-a2a2-e85d6ed987c9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:13.799794 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ae49e5bc-f977-4ad3-811b-235de287424e req-9ca40533-c771-4d99-a2a2-e85d6ed987c9 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0473588 Sep 01 17:05:13.836267 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ae49e5bc-f977-4ad3-811b-235de287424e req-7af2092b-a2a6-45ad-bede-521932dca4df tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0305357 Sep 01 17:05:14.958518 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd295110-7dbf-48df-9b58-fe065ccdc205 req-d610200d-fa2d-40ec-a41e-ddf0e1b2f48d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:14.960045 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bd295110-7dbf-48df-9b58-fe065ccdc205 req-d610200d-fa2d-40ec-a41e-ddf0e1b2f48d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0505979 Sep 01 17:05:15.000230 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-bd295110-7dbf-48df-9b58-fe065ccdc205 req-50ad2972-1b86-4181-bec4-9127d8b53d1d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0340791 Sep 01 17:05:15.587487 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:05:15.850951 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [req-f383d8b5-b380-4466-a84a-b55057b53f6e req-13901838-537c-49f5-ac1b-991e44d81d1c service neutron] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93836) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 17:05:15.851928 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f383d8b5-b380-4466-a84a-b55057b53f6e req-13901838-537c-49f5-ac1b-991e44d81d1c service neutron] 10.222.0.67 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0055203 Sep 01 17:05:16.003736 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cb9b9ba-ea7a-49cd-80c0-232bde92dcf3 req-9770f92d-222c-492c-9917-002a42e31fc3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:16.005228 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7cb9b9ba-ea7a-49cd-80c0-232bde92dcf3 req-9770f92d-222c-492c-9917-002a42e31fc3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0487309 Sep 01 17:05:16.048124 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7cb9b9ba-ea7a-49cd-80c0-232bde92dcf3 req-246eb918-de6f-40d8-ae43-5667b1cab78f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0369604 Sep 01 17:05:16.253946 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60286) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:05:16.338751 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-50dd04ed-7639-4d0e-9e00-b007510a5805 service neutron] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0832925 Sep 01 17:05:16.347725 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-69bce463-2a2b-4c8c-b07b-bdb495abc7bf service neutron] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93835) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 17:05:16.348688 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-69bce463-2a2b-4c8c-b07b-bdb495abc7bf service neutron] 10.222.0.67 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0051663 Sep 01 17:05:17.036276 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device c335b865-32be-49e5-9765-66a2bc067d1e no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:05:17.114743 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:17.143786 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c335b865-32be-49e5-9765-66a2bc067d1e'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:05:17.146074 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c4f0c54-0793-4d16-ad30-20fcaf793b25" -d '{"events": [{"server_uuid": "5e792cf3-d84a-40f8-af00-f4e251c62ed8", "name": "network-vif-unplugged", "status": "completed", "tag": "c335b865-32be-49e5-9765-66a2bc067d1e"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:05:17.159136 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port c335b865-32be-49e5-9765-66a2bc067d1e, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=c335b865-32be-49e5-9765-66a2bc067d1e,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:05:17.164429 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:17.179904 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b52c3d1-ccf2-4cd6-890d-419a13d4702f req-c3bda9b7-be2f-4c8a-a43b-516ebfc4ba8d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:17.181462 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6b52c3d1-ccf2-4cd6-890d-419a13d4702f req-c3bda9b7-be2f-4c8a-a43b-516ebfc4ba8d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 945 time: 0.0555081 Sep 01 17:05:17.193328 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Wed, 01 Sep 2021 17:05:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8600aba4-2adb-4d44-a1d6-84b29d5882a6 x-openstack-request-id: req-8600aba4-2adb-4d44-a1d6-84b29d5882a6 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:05:17.193639 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5e792cf3-d84a-40f8-af00-f4e251c62ed8", "name": "network-vif-unplugged", "status": "completed", "tag": "c335b865-32be-49e5-9765-66a2bc067d1e", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:05:17.193969 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-8600aba4-2adb-4d44-a1d6-84b29d5882a6 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:05:17.194264 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'code': 200} Sep 01 17:05:17.206374 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-5baaa009-030a-4bd2-a2a8-9ffe6fa140af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:17.208043 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-5baaa009-030a-4bd2-a2a8-9ffe6fa140af service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8&tenant_id=af7d370157f84ca198eb86180115a76f HTTP/1.1" status: 200 len: 1096 time: 0.0530062 Sep 01 17:05:17.221321 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=c335b865-32be-49e5-9765-66a2bc067d1e,revision_number=8']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:05:17.226021 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6b52c3d1-ccf2-4cd6-890d-419a13d4702f req-12c1a81b-744b-4cf0-98b6-5ba5ef843569 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379596 Sep 01 17:05:17.228686 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:05:17.229037 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:05:17.229394 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:05:17.229839 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:05:17.230173 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:05:17.230504 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:05:17.230830 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:05:17.231243 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:05:17.231562 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:05:17.231887 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:05:17.232212 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:05:17.232656 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:05:17.275705 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-d0e4419e-7277-4cb9-861c-be6ba7db55b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:17.277495 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-d0e4419e-7277-4cb9-861c-be6ba7db55b7 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 1096 time: 0.0456753 Sep 01 17:05:17.370193 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-5010cecf-ec9c-45d4-bd4b-1031335ad86d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:17.371655 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-5010cecf-ec9c-45d4-bd4b-1031335ad86d service neutron] 10.222.0.69 "GET /v2.0/networks?id=2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 200 len: 917 time: 0.0822716 Sep 01 17:05:17.449567 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-e249931f-23e7-496a-9588-05430b838a01 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c335b865-32be-49e5-9765-66a2bc067d1e HTTP/1.1" status: 200 len: 999 time: 0.0658448 Sep 01 17:05:17.498668 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-7017ab58-6407-481a-b9ed-bff8817b69d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:17.500117 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-7017ab58-6407-481a-b9ed-bff8817b69d4 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=58fe425a-6b3e-47bd-b5c0-e68ea7782780 HTTP/1.1" status: 200 len: 855 time: 0.0433068 Sep 01 17:05:17.550288 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-89dffebb-6012-4f68-80d1-a08e5abeb5ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:17.551768 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-89dffebb-6012-4f68-80d1-a08e5abeb5ef service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2f7bfe5e-0012-467f-ad7f-aea2467233ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0407462 Sep 01 17:05:17.660569 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-0f4e70ee-19c8-4ae2-b7e3-6cf081746efc service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0975769 Sep 01 17:05:18.002779 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f1af507-3f62-4522-8bbe-b3dadc4e1488 req-349684e3-9166-4b2e-b3be-a5a21f6a287c service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3310678 Sep 01 17:05:18.362179 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07f6b971-66c8-489e-82fa-0627bb9cdc3d req-786dd035-10b7-465a-b8df-d1a80e559bee tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:18.363903 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-07f6b971-66c8-489e-82fa-0627bb9cdc3d req-786dd035-10b7-465a-b8df-d1a80e559bee tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0573282 Sep 01 17:05:18.419399 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-07f6b971-66c8-489e-82fa-0627bb9cdc3d req-c432da99-3c03-4cea-b741-e2ee6c0907e8 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467188 Sep 01 17:05:19.573122 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f0f9555-e506-40c7-9ae9-8c136fb866fb req-5563630a-66b5-4668-ba1e-ce2cdb30f538 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:19.574660 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4f0f9555-e506-40c7-9ae9-8c136fb866fb req-5563630a-66b5-4668-ba1e-ce2cdb30f538 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0560162 Sep 01 17:05:19.620089 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4f0f9555-e506-40c7-9ae9-8c136fb866fb req-8e17f35e-43e4-45c6-a0ba-ac52959a9656 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394354 Sep 01 17:05:21.008416 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba552e5b-62bc-4f03-ba73-96938993799f req-53925d89-73bd-4c93-843d-76324d83549f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:21.009993 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ba552e5b-62bc-4f03-ba73-96938993799f req-53925d89-73bd-4c93-843d-76324d83549f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.2911553 Sep 01 17:05:21.050150 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ba552e5b-62bc-4f03-ba73-96938993799f req-2547e607-25b7-4893-98b1-4b923eb1c713 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0338829 Sep 01 17:05:21.243542 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-ef67dd57-7291-430d-974f-04710f417ed2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:22.170142 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeb625c3-1b71-4a64-a547-92f6185917c2 req-57b9dfc6-a0e8-4e3a-8657-e5511a39ee8f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:22.178225 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-eeb625c3-1b71-4a64-a547-92f6185917c2 req-57b9dfc6-a0e8-4e3a-8657-e5511a39ee8f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0573308 Sep 01 17:05:22.219656 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-eeb625c3-1b71-4a64-a547-92f6185917c2 req-2577a14e-975a-4d2f-88b9-485b0fa14c7d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386682 Sep 01 17:05:23.331363 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-777a9961-02f8-42ac-9777-411a29cbd363 req-d0b3c0c4-c7f3-477d-9306-03ec6a795d69 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:23.332845 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-777a9961-02f8-42ac-9777-411a29cbd363 req-d0b3c0c4-c7f3-477d-9306-03ec6a795d69 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0475411 Sep 01 17:05:23.373242 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-777a9961-02f8-42ac-9777-411a29cbd363 req-a0e8918f-7995-4b63-b308-d9183d2d857f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0345366 Sep 01 17:05:23.766769 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:23.783792 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-d5a33590-4b7c-4e50-92c6-d6496283ae8a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:24.497223 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e28bcab-a221-49fa-90bc-1fc35e831d88 req-1da5e2b0-3d51-45db-8786-f826672ca98f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:24.498815 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1e28bcab-a221-49fa-90bc-1fc35e831d88 req-1da5e2b0-3d51-45db-8786-f826672ca98f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0556066 Sep 01 17:05:24.545756 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1e28bcab-a221-49fa-90bc-1fc35e831d88 req-982dab5d-b160-4fd6-93d0-addd64311f4c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0356197 Sep 01 17:05:24.918150 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:25.675035 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2679d88d-3cbb-420b-8458-4e281df942e9 req-7188fbb6-dfe7-4f0b-8841-29ebae92f2f0 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:25.676528 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2679d88d-3cbb-420b-8458-4e281df942e9 req-7188fbb6-dfe7-4f0b-8841-29ebae92f2f0 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0554328 Sep 01 17:05:25.713714 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2679d88d-3cbb-420b-8458-4e281df942e9 req-ccb43b3f-28cf-4157-8e0b-08f1ff798d2e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314164 Sep 01 17:05:26.557201 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:26.616592 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:26.839927 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7772140-5ba1-45aa-a54a-235c52ee681d req-478d5856-9113-47c8-af15-a0382192c2c7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:26.841411 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d7772140-5ba1-45aa-a54a-235c52ee681d req-478d5856-9113-47c8-af15-a0382192c2c7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0506687 Sep 01 17:05:26.881897 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d7772140-5ba1-45aa-a54a-235c52ee681d req-b5bc4027-01e5-4fa5-8316-30cf7609766d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0342600 Sep 01 17:05:28.004943 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-866c9696-e169-405a-bfb2-4a4565b14274 req-1212f206-ae71-475f-9b0c-0682e470d94e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:28.007265 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-866c9696-e169-405a-bfb2-4a4565b14274 req-1212f206-ae71-475f-9b0c-0682e470d94e tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0511732 Sep 01 17:05:28.045977 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-866c9696-e169-405a-bfb2-4a4565b14274 req-93e91b8e-02fb-411a-b2cb-67ddd364c134 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0327499 Sep 01 17:05:29.177334 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c39f7f3c-5b99-42e8-a72e-82cc7ca3c390 req-73ac2f65-58a7-4062-8377-ffa01e4078e3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:29.179022 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c39f7f3c-5b99-42e8-a72e-82cc7ca3c390 req-73ac2f65-58a7-4062-8377-ffa01e4078e3 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0620127 Sep 01 17:05:29.230327 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c39f7f3c-5b99-42e8-a72e-82cc7ca3c390 req-87effd12-0c62-43a4-8ef8-503b1336533f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447581 Sep 01 17:05:30.348726 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9b730b4-972e-44eb-948e-873fd9ef74d0 req-5c05dd84-3673-4317-a940-2dd1695f0f85 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:30.350121 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f9b730b4-972e-44eb-948e-873fd9ef74d0 req-5c05dd84-3673-4317-a940-2dd1695f0f85 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0490909 Sep 01 17:05:30.390040 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f9b730b4-972e-44eb-948e-873fd9ef74d0 req-7f7032d1-fe36-4dff-8728-ce9f13165e0d tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0340927 Sep 01 17:05:31.509067 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43e237f4-0727-4c37-b360-2b02583f03e8 req-d41621eb-2843-4f16-8bd1-e37d87843302 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:31.510562 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-43e237f4-0727-4c37-b360-2b02583f03e8 req-d41621eb-2843-4f16-8bd1-e37d87843302 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0490077 Sep 01 17:05:31.548883 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-43e237f4-0727-4c37-b360-2b02583f03e8 req-797b8b37-46f5-4dff-bcf5-704acc7e27bf tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325222 Sep 01 17:05:32.674401 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d531636-9a58-4f71-995a-5061cd4d1d57 req-dc05b7c1-f26d-4a17-a3d2-b27286a526b8 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:32.675863 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8d531636-9a58-4f71-995a-5061cd4d1d57 req-dc05b7c1-f26d-4a17-a3d2-b27286a526b8 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0483234 Sep 01 17:05:32.713789 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8d531636-9a58-4f71-995a-5061cd4d1d57 req-92bea645-9c21-418b-b4f2-09fc24020796 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0321584 Sep 01 17:05:33.825556 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b6efa5a-596f-4807-9bde-97409db9ba12 req-ef20ab94-3ecb-4057-b1e4-57f427e4b460 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:33.827057 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9b6efa5a-596f-4807-9bde-97409db9ba12 req-ef20ab94-3ecb-4057-b1e4-57f427e4b460 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=af7d370157f84ca198eb86180115a76f&device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 1096 time: 0.0420632 Sep 01 17:05:33.834371 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f012fd80-5e3a-4c34-bdb7-f76ce5069d86 req-c5d65283-4634-4232-98d1-8b70f1e57650 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:33.835884 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f012fd80-5e3a-4c34-bdb7-f76ce5069d86 req-c5d65283-4634-4232-98d1-8b70f1e57650 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0487540 Sep 01 17:05:33.877146 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f012fd80-5e3a-4c34-bdb7-f76ce5069d86 req-ee820bc3-0091-458e-8728-362ce635c816 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0354395 Sep 01 17:05:33.934401 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b6efa5a-596f-4807-9bde-97409db9ba12 req-45b345d9-1edd-4875-8658-e0715be8ccc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:33.935856 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9b6efa5a-596f-4807-9bde-97409db9ba12 req-45b345d9-1edd-4875-8658-e0715be8ccc7 service neutron] 10.222.0.69 "GET /v2.0/networks?id=2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 200 len: 917 time: 0.0861592 Sep 01 17:05:34.000007 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9b6efa5a-596f-4807-9bde-97409db9ba12 req-9e3d8d81-54c9-4a48-ab34-6051898571e4 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c335b865-32be-49e5-9765-66a2bc067d1e HTTP/1.1" status: 200 len: 999 time: 0.0560863 Sep 01 17:05:34.054166 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b6efa5a-596f-4807-9bde-97409db9ba12 req-db852845-650d-45ea-99d9-6d4bcbbaef8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:34.055641 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9b6efa5a-596f-4807-9bde-97409db9ba12 req-db852845-650d-45ea-99d9-6d4bcbbaef8e service neutron] 10.222.0.69 "GET /v2.0/subnets?id=58fe425a-6b3e-47bd-b5c0-e68ea7782780 HTTP/1.1" status: 200 len: 855 time: 0.0461254 Sep 01 17:05:34.102167 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b6efa5a-596f-4807-9bde-97409db9ba12 req-0fac519c-97f5-4631-a55d-6a56ddf8a909 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:34.103607 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9b6efa5a-596f-4807-9bde-97409db9ba12 req-0fac519c-97f5-4631-a55d-6a56ddf8a909 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=2f7bfe5e-0012-467f-ad7f-aea2467233ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0389230 Sep 01 17:05:34.193968 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9b6efa5a-596f-4807-9bde-97409db9ba12 req-1c2c77ac-4dfe-445e-8255-05cd5c7c57d6 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802367 Sep 01 17:05:34.288676 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-9b6efa5a-596f-4807-9bde-97409db9ba12 req-eb6958c2-ac53-4abd-acd3-07b981016b75 service neutron] 10.222.0.69 "GET /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867498 Sep 01 17:05:34.995141 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c64c1d3e-728d-4c1a-a045-fe100b752c1e req-b8a6134c-c98b-48c9-9e47-f9a230df7fd5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:34.996617 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c64c1d3e-728d-4c1a-a045-fe100b752c1e req-b8a6134c-c98b-48c9-9e47-f9a230df7fd5 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0500867 Sep 01 17:05:35.035425 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c64c1d3e-728d-4c1a-a045-fe100b752c1e req-64b890bb-b8af-488d-8309-52a2b0efc0c7 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0327008 Sep 01 17:05:36.153468 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8449f674-5ba0-4bcb-b863-1cd6cb9d79ed req-a1f7fc7a-3166-4c39-8e64-0ea706dc0092 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:36.154924 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8449f674-5ba0-4bcb-b863-1cd6cb9d79ed req-a1f7fc7a-3166-4c39-8e64-0ea706dc0092 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0483797 Sep 01 17:05:36.192579 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8449f674-5ba0-4bcb-b863-1cd6cb9d79ed req-d6369b75-fd00-40e7-a83d-819465fe0586 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0311434 Sep 01 17:05:37.126655 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device c335b865-32be-49e5-9765-66a2bc067d1e details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:05:37.318459 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec9f8e7f-87e7-4fb2-aa58-ea1208e3730e req-1b55a141-8c03-4789-a46b-25e6c867c43c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:37.319961 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ec9f8e7f-87e7-4fb2-aa58-ea1208e3730e req-1b55a141-8c03-4789-a46b-25e6c867c43c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 943 time: 0.0532298 Sep 01 17:05:37.342981 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port c335b865-32be-49e5-9765-66a2bc067d1e, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=c335b865-32be-49e5-9765-66a2bc067d1e,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:05:37.354154 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'port_id': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'mac_address': 'fa:16:3e:96:5a:bf', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 544, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:05:37.362437 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ec9f8e7f-87e7-4fb2-aa58-ea1208e3730e req-79b125fd-5d46-44c8-b470-9cfefaaeee60 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0363922 Sep 01 17:05:37.394673 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:37.409307 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c335b865-32be-49e5-9765-66a2bc067d1e {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:05:37.429980 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port c335b865-32be-49e5-9765-66a2bc067d1e, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=c335b865-32be-49e5-9765-66a2bc067d1e,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:05:37.433922 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:37.480831 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=c335b865-32be-49e5-9765-66a2bc067d1e,revision_number=9']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:05:37.736530 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['c335b865-32be-49e5-9765-66a2bc067d1e'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:05:38.483219 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b2185a-0a23-4f4a-b69a-c0fe2a10b3ab req-e6c5101e-19f2-4af1-97f4-70295865d673 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:38.484742 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b7b2185a-0a23-4f4a-b69a-c0fe2a10b3ab req-e6c5101e-19f2-4af1-97f4-70295865d673 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 944 time: 0.0505953 Sep 01 17:05:38.521471 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b7b2185a-0a23-4f4a-b69a-c0fe2a10b3ab req-7ae645b2-2a1d-4c0a-929e-5fab2288c0fd tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0302317 Sep 01 17:05:39.110549 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device c335b865-32be-49e5-9765-66a2bc067d1e up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:05:39.157131 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port c335b865-32be-49e5-9765-66a2bc067d1e triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:05:39.157527 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:39.232161 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:39.254726 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c335b865-32be-49e5-9765-66a2bc067d1e'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:05:39.256953 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-34776677-b920-474e-ae95-27a5df551c26" -d '{"events": [{"server_uuid": "5e792cf3-d84a-40f8-af00-f4e251c62ed8", "name": "network-vif-plugged", "status": "completed", "tag": "c335b865-32be-49e5-9765-66a2bc067d1e"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:05:39.271459 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port c335b865-32be-49e5-9765-66a2bc067d1e, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=c335b865-32be-49e5-9765-66a2bc067d1e,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:05:39.275580 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:39.298401 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:05:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-922c1a66-1209-44c7-a221-92381979a2c4 x-openstack-request-id: req-922c1a66-1209-44c7-a221-92381979a2c4 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:05:39.298692 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5e792cf3-d84a-40f8-af00-f4e251c62ed8", "name": "network-vif-plugged", "status": "completed", "tag": "c335b865-32be-49e5-9765-66a2bc067d1e", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:05:39.298944 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-922c1a66-1209-44c7-a221-92381979a2c4 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:05:39.299561 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'code': 200} Sep 01 17:05:39.325399 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=c335b865-32be-49e5-9765-66a2bc067d1e,revision_number=10']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:05:39.490748 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd40acd1-c3fa-4b12-8fd2-e8be5b7e5b37 req-f090010a-c708-4ddb-aae6-d8a714905e9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:39.492411 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-fd40acd1-c3fa-4b12-8fd2-e8be5b7e5b37 req-f090010a-c708-4ddb-aae6-d8a714905e9e service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 1099 time: 0.0400629 Sep 01 17:05:39.528574 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-fd40acd1-c3fa-4b12-8fd2-e8be5b7e5b37 req-91066bf2-92bb-45b0-b45f-035bd97b999c service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0287936 Sep 01 17:05:39.637850 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e6dc5e-8ec7-4d9d-9ade-e475ca9bc5cf req-f7a278ef-a7ff-4758-80e3-767120942f70 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:39.639294 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f3e6dc5e-8ec7-4d9d-9ade-e475ca9bc5cf req-f7a278ef-a7ff-4758-80e3-767120942f70 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 946 time: 0.0475028 Sep 01 17:05:39.675881 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f3e6dc5e-8ec7-4d9d-9ade-e475ca9bc5cf req-6a2017df-07d7-44aa-906a-70cb7824bd60 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0307364 Sep 01 17:05:40.799900 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-175bdc67-802c-4d4c-a666-2ee0b0a6b2cb req-b5037819-5b26-460a-b2d9-a6196933eb56 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:40.801543 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-175bdc67-802c-4d4c-a666-2ee0b0a6b2cb req-b5037819-5b26-460a-b2d9-a6196933eb56 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 946 time: 0.0514197 Sep 01 17:05:40.845866 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-175bdc67-802c-4d4c-a666-2ee0b0a6b2cb req-06e60b80-bfa6-4553-b66a-c38a1e8033f8 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383911 Sep 01 17:05:41.963947 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f0ee4c1-107c-4561-a379-0d1ef0c5ff61 req-b70d64c8-f93f-46bc-b5cc-a52596825e76 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:05:41.965460 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1f0ee4c1-107c-4561-a379-0d1ef0c5ff61 req-b70d64c8-f93f-46bc-b5cc-a52596825e76 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 946 time: 0.0500877 Sep 01 17:05:42.004009 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1f0ee4c1-107c-4561-a379-0d1ef0c5ff61 req-f9f8f7c6-d902-49ef-8372-c05e8d24504b tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0326445 Sep 01 17:05:51.243716 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-8c526bc4-94c1-49e6-a6d9-e2d1490447da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:52.586732 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:05:53.769273 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:53.785126 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-89303aea-5f1b-4c2e-8f32-dfd016a3b85d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:54.923557 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:56.560469 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:05:56.605493 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:15.635857 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08ec5ace-5a6d-476a-9a25-1966756561a5 req-024caafa-18ed-4e50-9795-998d727467c1 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:15.637312 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-08ec5ace-5a6d-476a-9a25-1966756561a5 req-024caafa-18ed-4e50-9795-998d727467c1 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 946 time: 0.0482426 Sep 01 17:06:15.674789 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-08ec5ace-5a6d-476a-9a25-1966756561a5 req-892e519b-f7d6-4bf8-b64c-d3967136922f tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314662 Sep 01 17:06:16.798871 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38c05efa-8654-4966-90d4-ee2e848fcef8 req-c2da556a-b766-4367-952a-0e216bc34374 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:16.798871 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-38c05efa-8654-4966-90d4-ee2e848fcef8 req-c2da556a-b766-4367-952a-0e216bc34374 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 946 time: 0.0484571 Sep 01 17:06:16.838011 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-38c05efa-8654-4966-90d4-ee2e848fcef8 req-3968d008-aa6d-414a-a600-0aee27c78ee1 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups?id=5e077c29-f364-4757-85f6-20d583655da1&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0340993 Sep 01 17:06:17.158545 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-8181feb6-7721-4602-8b13-2a3f91c7222a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:17.160086 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-8181feb6-7721-4602-8b13-2a3f91c7222a tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.69 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 946 time: 0.0522134 Sep 01 17:06:17.260402 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Deleting port c335b865-32be-49e5-9765-66a2bc067d1e {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:06:17.260965 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:17.354178 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] For port c335b865-32be-49e5-9765-66a2bc067d1e, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=c335b865-32be-49e5-9765-66a2bc067d1e,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:17.354578 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:17.528097 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for floatingip, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:17.528405 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:17.528728 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.l3_db [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Floating IP 3348b2d7-616e-4187-b53c-37f9077d14e3 disassociated. External IP: 172.27.1.183, port: c335b865-32be-49e5-9765-66a2bc067d1e. Sep 01 17:06:17.529071 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Calling delete_port for c335b865-32be-49e5-9765-66a2bc067d1e owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:06:17.655794 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:17.687629 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event deleted for resources: {'Port': ['ID=c335b865-32be-49e5-9765-66a2bc067d1e,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:17.699011 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:17.699225 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:17.699528 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:17.699910 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:17.700244 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:17.700649 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:17.700981 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:17.701309 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:17.701659 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:17.701988 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:17.702348 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:17.702736 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:17.809981 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:06:17.923272 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:06:17.933876 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ca7cb54-9d5d-4db3-bc7c-768b7f7d9d17 None None] Sync routers for ids ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:06:17.943777 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ca7cb54-9d5d-4db3-bc7c-768b7f7d9d17 None None] Routers {'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:06:17.944486 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-9ca7cb54-9d5d-4db3-bc7c-768b7f7d9d17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:05:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:17.957286 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-298cab31-8c69-4d7a-8941-e44ee3d3f9d1 req-9edcf3da-d841-41f5-ba9e-e67ae6389e39 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/ports?device_id=5e792cf3-d84a-40f8-af00-f4e251c62ed8 HTTP/1.1" status: 200 len: 210 time: 0.0340438 Sep 01 17:06:17.963515 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] No DVR routers for this DVR port c335b865-32be-49e5-9765-66a2bc067d1e on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:06:17.965940 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:17.968079 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-70e532c1-141f-49cf-94c4-ccbd40a00595 req-b9914e8f-7a2e-4c28-8e84-5a84c7356c5c tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.69 "DELETE /v2.0/ports/c335b865-32be-49e5-9765-66a2bc067d1e HTTP/1.1" status: 204 len: 173 time: 0.8007753 Sep 01 17:06:17.969608 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'name': 'network-vif-deleted', 'tag': 'c335b865-32be-49e5-9765-66a2bc067d1e'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:06:17.973780 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-74521473-1890-4b9e-84ab-f67c7da51bb9" -d '{"events": [{"server_uuid": "5e792cf3-d84a-40f8-af00-f4e251c62ed8", "name": "network-vif-deleted", "tag": "c335b865-32be-49e5-9765-66a2bc067d1e"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:06:18.011038 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:06:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a400b0a1-be5c-45ec-95b0-b571bf8a25ef x-openstack-request-id: req-a400b0a1-be5c-45ec-95b0-b571bf8a25ef {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:06:18.011349 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5e792cf3-d84a-40f8-af00-f4e251c62ed8", "name": "network-vif-deleted", "tag": "c335b865-32be-49e5-9765-66a2bc067d1e", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:06:18.011594 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-a400b0a1-be5c-45ec-95b0-b571bf8a25ef {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:06:18.011968 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5e792cf3-d84a-40f8-af00-f4e251c62ed8', 'name': 'network-vif-deleted', 'tag': 'c335b865-32be-49e5-9765-66a2bc067d1e', 'status': 'completed', 'code': 200} Sep 01 17:06:18.069623 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-9ca7cb54-9d5d-4db3-bc7c-768b7f7d9d17 None None] Set router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:06:18.279614 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-9ca7cb54-9d5d-4db3-bc7c-768b7f7d9d17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:39Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:18.304459 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ca7cb54-9d5d-4db3-bc7c-768b7f7d9d17 None None] Checking router: e95cfaf6-7dbf-4e42-af63-5c1ea40c693e for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:06:18.313048 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ca7cb54-9d5d-4db3-bc7c-768b7f7d9d17 None None] Routers {'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:06:18.313685 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-9ca7cb54-9d5d-4db3-bc7c-768b7f7d9d17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:05:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:18.415319 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-9ca7cb54-9d5d-4db3-bc7c-768b7f7d9d17 None None] Set router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:06:18.607954 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-9ca7cb54-9d5d-4db3-bc7c-768b7f7d9d17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:39Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:18.634160 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ca7cb54-9d5d-4db3-bc7c-768b7f7d9d17 None None] The sync data for ids ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'] in dv-cinder-799668-16-iscsi is: [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T16:58:26Z', 'revision_number': 4, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '99045034-e927-44d2-85d3-7df40bb8cb9b', 'name': '', 'network_id': '2f7bfe5e-0012-467f-ad7f-aea2467233ac', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'mac_address': 'fa:16:3e:5c:fd:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:25Z', 'updated_at': '2021-09-01T16:58:39Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'subnets': [{'id': '58fe425a-6b3e-47bd-b5c0-e68ea7782780', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:06:18.845171 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcb3259d-97fc-4dd0-b142-2033f905cfb2 None None] New status for floating IP 3348b2d7-616e-4187-b53c-37f9077d14e3: DOWN {{(pid=93838) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:06:19.047913 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60450) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:19.103447 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-270ef618-8e04-497a-80b9-de3745627ffc tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:19.128658 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-270ef618-8e04-497a-80b9-de3745627ffc tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:19.175151 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-270ef618-8e04-497a-80b9-de3745627ffc tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:19.177833 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-270ef618-8e04-497a-80b9-de3745627ffc tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:19.179028 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-270ef618-8e04-497a-80b9-de3745627ffc tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "DELETE /v2.0/security-groups/5e077c29-f364-4757-85f6-20d583655da1 HTTP/1.1" status: 204 len: 168 time: 0.1300838 Sep 01 17:06:19.181798 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60452) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:19.189020 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270ef618-8e04-497a-80b9-de3745627ffc tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e077c29-f364-4757-85f6-20d583655da1,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:19.198184 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.api.v2.resource [None req-9ea5f2c3-d28a-4f0e-bc5b-ea1ddb34e258 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] show failed (client error): The resource could not be found. Sep 01 17:06:19.199260 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-9ea5f2c3-d28a-4f0e-bc5b-ea1ddb34e258 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "GET /v2.0/security-groups/5e077c29-f364-4757-85f6-20d583655da1 HTTP/1.1" status: 404 len: 347 time: 0.0163915 Sep 01 17:06:19.202492 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60454) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:19.326443 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Deleting port f68ae185-b6ef-446a-9f1b-9395fd040992 {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:06:19.326783 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:19.400102 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:19.400434 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:19.411921 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Calling delete_port for f68ae185-b6ef-446a-9f1b-9395fd040992 owned by network:floatingip {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:06:19.539712 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:19.565237 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Pushing event deleted for resources: {'Port': ['ID=f68ae185-b6ef-446a-9f1b-9395fd040992,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:19.591449 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:19.591797 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:19.592137 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:19.592473 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:19.593349 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:19.593709 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:19.594207 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:19.594687 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:19.595028 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:19.595383 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:19.595945 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:19.596400 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:19.638227 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks [] for floatingip, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:19.640753 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:19.641919 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-ef754d33-fe9f-4101-b31a-45d543860632 tempest-AttachVolumeShelveTestJSON-804661 tempest-AttachVolumeShelveTestJSON-804661-project] 10.222.0.67 "DELETE /v2.0/floatingips/3348b2d7-616e-4187-b53c-37f9077d14e3 HTTP/1.1" status: 204 len: 168 time: 0.4382961 Sep 01 17:06:21.176475 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12476c7b-9b3e-4fbb-8839-ae8aff08cc19 req-dc23a087-94b3-4b60-ae73-82fe12a91902 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:21.177987 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-12476c7b-9b3e-4fbb-8839-ae8aff08cc19 req-dc23a087-94b3-4b60-ae73-82fe12a91902 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0494707 Sep 01 17:06:21.217015 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-12476c7b-9b3e-4fbb-8839-ae8aff08cc19 req-0e903553-42a3-4e96-8b93-38966875a34b tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0332623 Sep 01 17:06:21.243928 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-0ba0d469-ba94-42bc-be08-743d15032f43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:22.241694 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device c335b865-32be-49e5-9765-66a2bc067d1e no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:06:22.261919 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: c335b865-32be-49e5-9765-66a2bc067d1e {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:06:22.262518 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device c335b865-32be-49e5-9765-66a2bc067d1e not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:06:22.335845 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19bc4eb7-5720-43e8-bc08-412575f9f978 req-5480449d-8a35-434b-a1bd-5a69da3c8085 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:22.337324 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-19bc4eb7-5720-43e8-bc08-412575f9f978 req-5480449d-8a35-434b-a1bd-5a69da3c8085 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0484393 Sep 01 17:06:22.376163 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-19bc4eb7-5720-43e8-bc08-412575f9f978 req-172e99e1-51c1-469f-9993-d9b97c7c62ea tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0322807 Sep 01 17:06:23.503604 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ecb1199-26d0-41cc-bee4-43230001e0f5 req-30615654-b859-4f85-bead-732909a07d66 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:23.505320 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3ecb1199-26d0-41cc-bee4-43230001e0f5 req-30615654-b859-4f85-bead-732909a07d66 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0616345 Sep 01 17:06:23.548953 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3ecb1199-26d0-41cc-bee4-43230001e0f5 req-26614541-98c5-4cfd-a55c-8a567b7872e3 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0366094 Sep 01 17:06:23.777957 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:23.789843 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-e5196a1f-91c9-4e21-9716-57c904c4d550 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:24.165614 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60500) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:24.623630 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9facb86f-c9d4-41ab-a31b-a9998ff04d44 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1832465'] for router_interface, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:24.747911 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c47172f4-790f-4c3f-843e-acc1391d399e req-d99f1cf7-06d0-4cc9-91b5-cc239dcc805c tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:24.750251 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c47172f4-790f-4c3f-843e-acc1391d399e req-d99f1cf7-06d0-4cc9-91b5-cc239dcc805c tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.1296320 Sep 01 17:06:24.827637 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c47172f4-790f-4c3f-843e-acc1391d399e req-fa2b812b-277c-4fd3-a97e-e84961019a08 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0686224 Sep 01 17:06:24.923036 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:24.949615 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-9facb86f-c9d4-41ab-a31b-a9998ff04d44 admin admin] Deleting port 99045034-e927-44d2-85d3-7df40bb8cb9b {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:06:24.949966 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9facb86f-c9d4-41ab-a31b-a9998ff04d44 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:25.027088 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [None req-9facb86f-c9d4-41ab-a31b-a9998ff04d44 admin admin] For port 99045034-e927-44d2-85d3-7df40bb8cb9b, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=99045034-e927-44d2-85d3-7df40bb8cb9b,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:25.027448 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9facb86f-c9d4-41ab-a31b-a9998ff04d44 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:25.040472 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-9facb86f-c9d4-41ab-a31b-a9998ff04d44 admin admin] Calling delete_port for 99045034-e927-44d2-85d3-7df40bb8cb9b owned by network:router_interface {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:06:25.219062 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9facb86f-c9d4-41ab-a31b-a9998ff04d44 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:25.248073 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9facb86f-c9d4-41ab-a31b-a9998ff04d44 admin admin] Pushing event deleted for resources: {'Port': ['ID=99045034-e927-44d2-85d3-7df40bb8cb9b,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:25.412605 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9facb86f-c9d4-41ab-a31b-a9998ff04d44 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611377', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1832589'] for router_interface, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:25.620624 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9facb86f-c9d4-41ab-a31b-a9998ff04d44 admin admin] Router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:06:25.723560 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9facb86f-c9d4-41ab-a31b-a9998ff04d44 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:06:25.728137 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-9facb86f-c9d4-41ab-a31b-a9998ff04d44 admin admin] 10.222.0.67 "PUT /v2.0/routers/e95cfaf6-7dbf-4e42-af63-5c1ea40c693e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5614967 Sep 01 17:06:25.730685 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60518) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:25.734762 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcac0ed4-a814-4c84-b5a1-3b4007bc19eb None None] Sync routers for ids ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:06:25.744404 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcac0ed4-a814-4c84-b5a1-3b4007bc19eb None None] Routers {'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:06:25.745016 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-bcac0ed4-a814-4c84-b5a1-3b4007bc19eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:06:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:25.834527 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] Notify callbacks [] for router, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:25.846277 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-bcac0ed4-a814-4c84-b5a1-3b4007bc19eb None None] Set router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:06:26.033182 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-bcac0ed4-a814-4c84-b5a1-3b4007bc19eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T17:06:25Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:26.060609 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcac0ed4-a814-4c84-b5a1-3b4007bc19eb None None] Checking router: e95cfaf6-7dbf-4e42-af63-5c1ea40c693e for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:06:26.070905 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcac0ed4-a814-4c84-b5a1-3b4007bc19eb None None] Routers {'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:06:26.071572 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-bcac0ed4-a814-4c84-b5a1-3b4007bc19eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:06:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:26.177011 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-bcac0ed4-a814-4c84-b5a1-3b4007bc19eb None None] Set router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:06:26.198898 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd506d9f-a2bb-458e-9f50-83ba4c9e0ca2 req-ce2bef2e-ddbc-4dc5-b7fc-873b8fa80155 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:26.200387 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cd506d9f-a2bb-458e-9f50-83ba4c9e0ca2 req-ce2bef2e-ddbc-4dc5-b7fc-873b8fa80155 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0948803 Sep 01 17:06:26.226278 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:26.269019 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cd506d9f-a2bb-458e-9f50-83ba4c9e0ca2 req-a6576fe9-6025-4178-b846-5906ba88dbe3 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0594640 Sep 01 17:06:26.291795 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] Deleting port 451f37bd-beb9-4944-a58c-21316e8aa987 {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:06:26.292148 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:26.352241 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-bcac0ed4-a814-4c84-b5a1-3b4007bc19eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T17:06:25Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:26.373135 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] For port 451f37bd-beb9-4944-a58c-21316e8aa987, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=451f37bd-beb9-4944-a58c-21316e8aa987,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:26.373534 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:26.381888 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcac0ed4-a814-4c84-b5a1-3b4007bc19eb None None] The sync data for ids ['e95cfaf6-7dbf-4e42-af63-5c1ea40c693e'] in dv-cinder-799668-16-iscsi is: [{'id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'name': 'tempest-AttachVolumeShelveTestJSON-214033632-router', 'tenant_id': 'af7d370157f84ca198eb86180115a76f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112'}], 'enable_snat': True}, 'gw_port_id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T16:58:19Z', 'updated_at': '2021-09-01T17:06:25Z', 'revision_number': 5, 'project_id': 'af7d370157f84ca198eb86180115a76f', 'gw_port': {'id': '451f37bd-beb9-4944-a58c-21316e8aa987', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:b8:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e95cfaf6-7dbf-4e42-af63-5c1ea40c693e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T16:58:21Z', 'updated_at': '2021-09-01T16:58:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:06:26.385966 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] Calling delete_port for 451f37bd-beb9-4944-a58c-21316e8aa987 owned by network:router_gateway {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:06:26.558847 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:26.563219 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:26.583943 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] Pushing event deleted for resources: {'Port': ['ID=451f37bd-beb9-4944-a58c-21316e8aa987,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:26.611525 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:26.645147 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1827887'] for router_gateway, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:26.742535 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1821713', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4617'] for router, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:26.744934 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:26.795733 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1821722'] for router, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:26.796279 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router e95cfaf6-7dbf-4e42-af63-5c1ea40c693e {{(pid=93836) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 01 17:06:26.802083 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] Notify callbacks [] for router, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:26.805516 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-35369ea5-d5c8-4a24-bc12-418cadcbf5e9 admin admin] 10.222.0.67 "DELETE /v2.0/routers/e95cfaf6-7dbf-4e42-af63-5c1ea40c693e HTTP/1.1" status: 204 len: 168 time: 1.0715899 Sep 01 17:06:26.805914 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60524) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:26.868042 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 99045034-e927-44d2-85d3-7df40bb8cb9b no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:06:26.871528 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_v2 [None req-efc4f42b-d4ee-4d34-a0a0-e774532029ea admin admin] Deleting subnet 58fe425a-6b3e-47bd-b5c0-e68ea7782780 {{(pid=93835) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 17:06:26.874688 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-efc4f42b-d4ee-4d34-a0a0-e774532029ea admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:26.916322 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-efc4f42b-d4ee-4d34-a0a0-e774532029ea admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8197692'] for subnet, precommit_delete_associations {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.000757 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-efc4f42b-d4ee-4d34-a0a0-e774532029ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.013991 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 99045034-e927-44d2-85d3-7df40bb8cb9b {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:06:27.014374 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 99045034-e927-44d2-85d3-7df40bb8cb9b not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:06:27.060603 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-efc4f42b-d4ee-4d34-a0a0-e774532029ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7342711', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5120114'] for subnet, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.093449 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efc4f42b-d4ee-4d34-a0a0-e774532029ea admin admin] Pushing event deleted for resources: {'Subnet': ['ID=58fe425a-6b3e-47bd-b5c0-e68ea7782780,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:27.103542 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-efc4f42b-d4ee-4d34-a0a0-e774532029ea admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.105532 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-efc4f42b-d4ee-4d34-a0a0-e774532029ea admin admin] 10.222.0.67 "DELETE /v2.0/subnets/58fe425a-6b3e-47bd-b5c0-e68ea7782780 HTTP/1.1" status: 204 len: 168 time: 0.2982159 Sep 01 17:06:27.108020 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60526) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:27.112800 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a06e183-7c07-43a5-8ea8-8815676e5ab0 None None] Network 2f7bfe5e-0012-467f-ad7f-aea2467233ac requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:06:27.176801 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.232036 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Deleting port 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:06:27.232389 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.299785 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] For port 9372f287-95c6-4b7b-bfd9-6d01ccd217a8, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=9372f287-95c6-4b7b-bfd9-6d01ccd217a8,segment=NetworkSegment(bec5369a-b830-4662-87e0-2fcfaf3604ff),segment_id=bec5369a-b830-4662-87e0-2fcfaf3604ff)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:27.300157 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.313667 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Calling delete_port for 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 owned by network:dhcp {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:06:27.386480 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6712e99b-16c7-4d0c-b9cd-5ac2e9157ef9 req-0bc29e73-0f5d-42af-ad68-7fc4057bf085 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:27.387967 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6712e99b-16c7-4d0c-b9cd-5ac2e9157ef9 req-0bc29e73-0f5d-42af-ad68-7fc4057bf085 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0491331 Sep 01 17:06:27.393351 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.420196 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Pushing event deleted for resources: {'Port': ['ID=9372f287-95c6-4b7b-bfd9-6d01ccd217a8,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:27.424169 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] No DVR routers for this DVR port 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 on host dv-cinder-799668-16-iscsi {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:06:27.438953 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6712e99b-16c7-4d0c-b9cd-5ac2e9157ef9 req-1c5eaed9-abfc-41ba-b4fc-6b962faab2fa tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0436468 Sep 01 17:06:27.458182 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c22427bc-fe27-4fb4-89e8-53e11a4443df None None] DHCP port deletion for 2f7bfe5e-0012-467f-ad7f-aea2467233ac request from dv-cinder-799668-16-iscsi {{(pid=93837) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 01 17:06:27.500837 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.510606 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2f7bfe5e-0012-467f-ad7f-aea2467233ac']}} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:27.521339 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bec5369a-b830-4662-87e0-2fcfaf3604ff') {'for_net_delete': True} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:27.521673 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bec5369a-b830-4662-87e0-2fcfaf3604ff') {} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:27.531251 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8197639'] for segment, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.544610 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.550821 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Releasing vlan 544 on physical network physnet1 to pool {{(pid=93835) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 17:06:27.551204 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7342797'] for segment, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: Traceback (most recent call last): Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: timer() Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: cb(*args, **kw) Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: return func(*args, **kwargs) Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: self._notify() Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: self.callback(batched_events) Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: event.method(event) Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: return f(self, *a, **k) Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._get(url).json() Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: return self.request(url, 'GET', **kwargs) Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 17:06:27.552786 dv-cinder-799668-16-iscsi neutron-server[93835]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 17:06:27.609609 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.614224 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.616329 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] 10.222.0.67 "DELETE /v2.0/networks/2f7bfe5e-0012-467f-ad7f-aea2467233ac HTTP/1.1" status: 204 len: 168 time: 0.5064244 Sep 01 17:06:27.629014 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-737e2d2f-b7de-43b1-af60-6b3d4815aa40 admin admin] Pushing event deleted for resources: {'Network': ['ID=2f7bfe5e-0012-467f-ad7f-aea2467233ac,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:27.728276 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60532) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:27.767844 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-37303f9b-0ba9-4a44-83e5-6e0b5fe6e36c admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=af7d370157f84ca198eb86180115a76f&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0384045 Sep 01 17:06:27.770210 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60534) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:27.816616 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2ee8a552-7388-4d48-8794-ce08ea645608 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.837713 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2ee8a552-7388-4d48-8794-ce08ea645608 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.883950 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2ee8a552-7388-4d48-8794-ce08ea645608 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.886531 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-2ee8a552-7388-4d48-8794-ce08ea645608 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:27.891254 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-2ee8a552-7388-4d48-8794-ce08ea645608 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/3ab45ad1-bac9-4ede-994c-52c6ec6bb350 HTTP/1.1" status: 204 len: 168 time: 0.1166060 Sep 01 17:06:27.898522 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ee8a552-7388-4d48-8794-ce08ea645608 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ab45ad1-bac9-4ede-994c-52c6ec6bb350,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:28.152964 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-01a74bc8-1f5b-4a11-b4b2-8beb505eb0f4 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1200574755&fields=id&tenant_id=63c213b6da7541a0ba2b290c5e15fe03 HTTP/1.1" status: 200 len: 267 time: 0.0342596 Sep 01 17:06:28.270845 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-19c3ca39-f6b3-4024-bbca-da0add0c6d8c tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:28.272418 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-19c3ca39-f6b3-4024-bbca-da0add0c6d8c tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 811 time: 0.1115282 Sep 01 17:06:28.288429 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-8e472afa-8bfc-4e74-a608-0552b9f93476 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/quotas/63c213b6da7541a0ba2b290c5e15fe03 HTTP/1.1" status: 200 len: 375 time: 0.0099759 Sep 01 17:06:28.346803 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-a376bc43-e868-4eb2-bcaa-52da8252fb0e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0529857 Sep 01 17:06:28.450140 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-3785fc43-a747-421a-8638-b09840eccea0 service neutron] 10.222.0.67 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0920985 Sep 01 17:06:28.579981 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-fca3c6c1-f642-4081-939b-14024e75155d service neutron] 10.222.0.67 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1219959 Sep 01 17:06:28.583565 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60568) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:28.585320 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 451f37bd-beb9-4944-a58c-21316e8aa987 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:06:28.592442 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6edc97f7-0840-4d34-a008-1189157e7a34 req-4433bc9d-b486-4187-9410-32382a7696e6 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:28.594772 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6edc97f7-0840-4d34-a008-1189157e7a34 req-4433bc9d-b486-4187-9410-32382a7696e6 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0740242 Sep 01 17:06:28.604982 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 451f37bd-beb9-4944-a58c-21316e8aa987 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:06:28.605326 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 451f37bd-beb9-4944-a58c-21316e8aa987 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:06:28.605792 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:06:28.626413 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:06:28.627011 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 9372f287-95c6-4b7b-bfd9-6d01ccd217a8 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:06:28.655924 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6edc97f7-0840-4d34-a008-1189157e7a34 req-c801c6db-b1d9-499c-989a-8ffcb9865bc4 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0510404 Sep 01 17:06:28.700729 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1166592683-network', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:06:28.725905 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] Made reservation on behalf of aef2053b969d4ca58b0e1ec3a7e7a06c for: {'network': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:06:28.728300 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for network, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:28.737567 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:28.836717 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:28.841261 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:28.868917 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] vlan segment allocate from pool success with {'vlan_id': 527, 'physical_network': 'physnet1'} {{(pid=93835) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 01 17:06:28.876216 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97653f8a-1566-456d-b255-a61890dc4dfd,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:28.883915 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:28.884244 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.segments_db [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] Added segment b1d56bb7-3afb-4733-a07b-8f143da5da35 of type vlan for network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 Sep 01 17:06:28.904596 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a590203f-c25b-4339-9939-c0dbefd28d8e req-131595d8-9edb-42c9-924f-07692688bd7d tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 210 time: 0.0284064 Sep 01 17:06:28.934034 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748408695152'] for network, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:28.959674 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366'] for network, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:28.960873 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:28.961495 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.019920 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] 10.222.0.67 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.4321640 Sep 01 17:06:29.020824 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60586) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:29.026729 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-3d3933a1-13e2-4cd3-ba9c-997fd86814c4 admin admin] Request body: {'subnet': {'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1166592683-subnet', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:06:29.027070 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-505b0220-d207-40a3-b949-1968ca02236b admin admin] Pushing event updated for resources: {'Network': ['ID=adfcf065-5df4-4f7a-9b14-3f96b61d0c25,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:29.039449 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 details requested by agent ovs-agent-dv-cinder-799668-16-iscsi with host dv-cinder-799668-16-iscsi {{(pid=93837) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 01 17:06:29.071240 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d3933a1-13e2-4cd3-ba9c-997fd86814c4 admin admin] Made reservation on behalf of aef2053b969d4ca58b0e1ec3a7e7a06c for: {'subnet': 1} {{(pid=93836) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:06:29.073695 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3d3933a1-13e2-4cd3-ba9c-997fd86814c4 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6181104'] for subnet, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.252466 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3d3933a1-13e2-4cd3-ba9c-997fd86814c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6280103', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6181094'] for subnet, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.308721 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d3933a1-13e2-4cd3-ba9c-997fd86814c4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=638b3e89-f5ce-4389-adde-079fe5b332cd,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:29.316951 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d3933a1-13e2-4cd3-ba9c-997fd86814c4 admin admin] Checking segment: {'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93836) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:06:29.317307 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d3933a1-13e2-4cd3-ba9c-997fd86814c4 admin admin] Network hostable DHCP agents. Network: adfcf065-5df4-4f7a-9b14-3f96b61d0c25, hostable agents: ['b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b'], hosted agents: [] {{(pid=93836) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 01 17:06:29.333168 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d3933a1-13e2-4cd3-ba9c-997fd86814c4 admin admin] Network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 is scheduled to be hosted by DHCP agent b97cc87f-20f1-4ec5-824f-0e5e9dd9e59b with binding_index 1 {{(pid=93836) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 01 17:06:29.341066 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-3d3933a1-13e2-4cd3-ba9c-997fd86814c4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799668-16-iscsi, adfcf065-5df4-4f7a-9b14-3f96b61d0c25) {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:06:29.344874 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d3933a1-13e2-4cd3-ba9c-997fd86814c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:29.345483 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-3d3933a1-13e2-4cd3-ba9c-997fd86814c4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.350004 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c70e6ff-587b-485e-a93f-1f480c89b8d9 None None] Network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:06:29.362548 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-3d3933a1-13e2-4cd3-ba9c-997fd86814c4 admin admin] 10.222.0.67 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3401735 Sep 01 17:06:29.362935 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60590) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:29.367710 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:06:29.390819 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1827089', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-4631'] for router, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.391943 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1833975', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1833092', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1830247', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-4608'] for router, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.455309 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.508929 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ce91fdb-f9d4-529e-8715-29775a2007ca-adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd'}]}} from dv-cinder-799668-16-iscsi. {{(pid=93837) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 01 17:06:29.509841 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.585469 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:06:29.605363 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.646977 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.db_base_plugin_common [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Allocated IP 172.20.0.2 (adfcf065-5df4-4f7a-9b14-3f96b61d0c25/638b3e89-f5ce-4389-adde-079fe5b332cd/75fbd6de-c7da-4bed-8fb8-60e2230aca29) {{(pid=93837) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:06:29.775792 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bdbc1f5-7fa9-4af7-9663-7ef90c02ec1a req-06238d80-3702-49f2-8df5-f04523240b1b tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:29.784333 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2bdbc1f5-7fa9-4af7-9663-7ef90c02ec1a req-06238d80-3702-49f2-8df5-f04523240b1b tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0580616 Sep 01 17:06:29.823839 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Notify callbacks [] for port, precommit_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.830636 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2bdbc1f5-7fa9-4af7-9663-7ef90c02ec1a req-cb160666-1659-459e-aa6d-00597b26f57d tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0452952 Sep 01 17:06:29.832989 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Transition to ACTIVE for port object 75fbd6de-c7da-4bed-8fb8-60e2230aca29 will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:06:29.849418 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Transition to ACTIVE for port object 75fbd6de-c7da-4bed-8fb8-60e2230aca29 will not be triggered until provisioned by entity DHCP. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:06:29.856665 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368'] for port, after_create {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.887903 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.897209 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 is already hosted by enough agents. {{(pid=93837) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:06:29.900137 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.scheduler.base_scheduler [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Resources bound (agent type, host, resource id): {{(pid=93837) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:06:29.904046 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Received port after_create {{(pid=93837) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:06:29.910289 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Pushing event updated for resources: {'Port': ['ID=75fbd6de-c7da-4bed-8fb8-60e2230aca29,revision_number=1']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:29.913315 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.922821 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:29.923240 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:29.923512 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:29.925184 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:29.925478 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:29.925821 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:29.926161 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:29.926494 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:29.926830 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:29.927160 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:29.927486 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:29.927812 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:29.981318 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Attempting to bind port 75fbd6de-c7da-4bed-8fb8-60e2230aca29 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:06:29.981719 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Attempting to bind port 75fbd6de-c7da-4bed-8fb8-60e2230aca29 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:06:29.982114 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Attempting to bind port 75fbd6de-c7da-4bed-8fb8-60e2230aca29 on network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:06:29.988245 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 6, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:06:29.988754 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Checking segment: {'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:06:29.989158 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.989575 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Bound using segment: {'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:06:29.990037 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Bound port: 75fbd6de-c7da-4bed-8fb8-60e2230aca29, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:06:29.990415 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:29.992152 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-c1ec1055-5da6-4508-a566-91dfdf27000a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:29.993640 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-c1ec1055-5da6-4508-a566-91dfdf27000a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 811 time: 0.1849656 Sep 01 17:06:30.033960 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9aa1ba5e-ec34-4c48-ad7a-b26ce0b4acb5 req-1558c109-687b-4a85-8afd-a9384086bb0e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 210 time: 0.0334740 Sep 01 17:06:30.069237 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] For port 75fbd6de-c7da-4bed-8fb8-60e2230aca29, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:06:30.072762 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] For port 75fbd6de-c7da-4bed-8fb8-60e2230aca29, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=75fbd6de-c7da-4bed-8fb8-60e2230aca29,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:06:30.076769 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:30.110664 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-ce4cfdcd-fb54-4061-90bd-0d7c91c59c40 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=63c213b6da7541a0ba2b290c5e15fe03 HTTP/1.1" status: 200 len: 380 time: 0.1003199 Sep 01 17:06:30.112336 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Allocated IP 172.27.1.158 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/d55b1a8d-8a79-43d6-8747-4bd1a56c7584) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:06:30.127203 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-235a1f4c-e449-427f-a4d7-5cd48e1a3afe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Request body: {'port': {'device_id': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'admin_state_up': True, 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'security_groups': ['8ded1df8-6989-4db0-876f-79e2a5cfe05e']}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:06:30.144535 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d39923f-8a26-4d24-a11d-1887ab1ecec2 None None] Pushing event updated for resources: {'Port': ['ID=75fbd6de-c7da-4bed-8fb8-60e2230aca29,revision_number=2']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:30.565408 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:30.571925 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-235a1f4c-e449-427f-a4d7-5cd48e1a3afe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Made reservation on behalf of 63c213b6da7541a0ba2b290c5e15fe03 for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:06:30.575647 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-235a1f4c-e449-427f-a4d7-5cd48e1a3afe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:30.616123 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 75fbd6de-c7da-4bed-8fb8-60e2230aca29 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:06:30.664072 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 75fbd6de-c7da-4bed-8fb8-60e2230aca29 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:06:30.675656 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:30.754535 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:06:30.762937 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:06:30.768001 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Pushing event updated for resources: {'Port': ['ID=d55b1a8d-8a79-43d6-8747-4bd1a56c7584,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:30.770393 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:06:30.776968 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-235a1f4c-e449-427f-a4d7-5cd48e1a3afe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Allocated IP 172.20.0.7 (35c995f2-96ec-4a35-9f59-05221a09df3f/ab89c120-a892-4afa-a645-bf3caf534f7c/f321a7eb-78b4-4ce9-b5ea-dc1dade4921b) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:06:30.963190 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0806c6de-1ad1-4fd3-b57b-6b07ea13c295 req-fdca3ac2-94e4-4aad-a541-8673abdaf748 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:30.964776 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0806c6de-1ad1-4fd3-b57b-6b07ea13c295 req-fdca3ac2-94e4-4aad-a541-8673abdaf748 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0542421 Sep 01 17:06:31.008032 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0806c6de-1ad1-4fd3-b57b-6b07ea13c295 req-e5028b10-874a-4714-9bd8-878c50e3ed81 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0360761 Sep 01 17:06:31.081369 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-594a8a11-f648-4fc6-bba9-01e7b36a9351 None None] Network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:06:31.104178 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-235a1f4c-e449-427f-a4d7-5cd48e1a3afe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:31.152700 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ec59851a-517f-4415-8321-1052e69f870d req-0eb4e625-9257-460e-abc0-1314af2c4584 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 210 time: 0.0330453 Sep 01 17:06:31.155569 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-f23b2884-0bed-4689-b527-521d3197d277 None None] Provisioning for port 75fbd6de-c7da-4bed-8fb8-60e2230aca29 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:06:31.156179 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-235a1f4c-e449-427f-a4d7-5cd48e1a3afe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Transition to ACTIVE for port object f321a7eb-78b4-4ce9-b5ea-dc1dade4921b will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:06:31.165799 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-f23b2884-0bed-4689-b527-521d3197d277 None None] Provisioning complete for port 75fbd6de-c7da-4bed-8fb8-60e2230aca29 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:06:31.166176 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-f23b2884-0bed-4689-b527-521d3197d277 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:31.173029 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:31.275306 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-235a1f4c-e449-427f-a4d7-5cd48e1a3afe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:31.312227 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-f23b2884-0bed-4689-b527-521d3197d277 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:31.332858 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-235a1f4c-e449-427f-a4d7-5cd48e1a3afe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Network 35c995f2-96ec-4a35-9f59-05221a09df3f is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:06:31.353781 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-f23b2884-0bed-4689-b527-521d3197d277 None None] For port 75fbd6de-c7da-4bed-8fb8-60e2230aca29, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=75fbd6de-c7da-4bed-8fb8-60e2230aca29,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:31.359429 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-f23b2884-0bed-4689-b527-521d3197d277 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:31.369218 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-235a1f4c-e449-427f-a4d7-5cd48e1a3afe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:06:31.373131 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-235a1f4c-e449-427f-a4d7-5cd48e1a3afe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:06:31.376258 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-235a1f4c-e449-427f-a4d7-5cd48e1a3afe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'Port': ['ID=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:31.427387 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f23b2884-0bed-4689-b527-521d3197d277 None None] Pushing event updated for resources: {'Port': ['ID=75fbd6de-c7da-4bed-8fb8-60e2230aca29,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:31.466250 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-235a1f4c-e449-427f-a4d7-5cd48e1a3afe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:31.466915 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-235a1f4c-e449-427f-a4d7-5cd48e1a3afe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:31.492686 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-235a1f4c-e449-427f-a4d7-5cd48e1a3afe tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3749108 Sep 01 17:06:31.495587 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1833934', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1833207'] for router, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:31.507448 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Request body: {'port': {'device_id': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:06:31.579600 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-2755ebc7-e763-4024-888e-1d2804dffe34 None None] Provisioning complete for port 75fbd6de-c7da-4bed-8fb8-60e2230aca29 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:06:31.580273 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-2755ebc7-e763-4024-888e-1d2804dffe34 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:31.647278 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:31.781330 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-fb2679ba-7054-4f0d-a284-892677f0a51e None None] Provisioning for port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:06:31.783417 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Router 983dc48a-7f67-4eed-9560-9f50c5b92a36 is scheduled to L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c with binding_index 1 {{(pid=93835) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 01 17:06:31.785002 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-fb2679ba-7054-4f0d-a284-892677f0a51e None None] Provisioning complete for port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:06:31.785376 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-fb2679ba-7054-4f0d-a284-892677f0a51e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:31.818949 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-fb2679ba-7054-4f0d-a284-892677f0a51e None None] Port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:06:31.972137 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:06:31.981096 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Sync routers for ids ['983dc48a-7f67-4eed-9560-9f50c5b92a36'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:06:31.992011 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Routers {'983dc48a-7f67-4eed-9560-9f50c5b92a36'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:06:31.992795 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:06:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['983dc48a-7f67-4eed-9560-9f50c5b92a36'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:32.001328 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] Notify callbacks [] for router, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:32.002647 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-494598db-6745-498a-92fa-ab199b822b7e admin admin] 10.222.0.67 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.6385982 Sep 01 17:06:32.005447 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60600) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:32.037868 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f321a7eb-78b4-4ce9-b5ea-dc1dade4921b {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:06:32.051494 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:32.066814 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Transition to ACTIVE for port object f321a7eb-78b4-4ce9-b5ea-dc1dade4921b will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:06:32.071814 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:32.120992 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Set router 983dc48a-7f67-4eed-9560-9f50c5b92a36 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:06:32.126866 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Pushing event updated for resources: {'Port': ['ID=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:32.253934 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Attempting to bind port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:06:32.254344 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Attempting to bind port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:06:32.254822 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Attempting to bind port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b on network 35c995f2-96ec-4a35-9f59-05221a09df3f {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:06:32.260425 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b on network 35c995f2-96ec-4a35-9f59-05221a09df3f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:06:32.266272 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Attempting to bind port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b on network 35c995f2-96ec-4a35-9f59-05221a09df3f {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:06:32.270781 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d3d18f1-b2c5-406b-86cc-3514ecbe48f3 req-98a25d9f-d639-4f10-b38d-ebad281cb7e9 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:32.272378 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9d3d18f1-b2c5-406b-86cc-3514ecbe48f3 req-98a25d9f-d639-4f10-b38d-ebad281cb7e9 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0963624 Sep 01 17:06:32.275839 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 6, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:06:32.278348 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Checking segment: {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:06:32.278859 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Bound using segment: {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:06:32.279419 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Bound port: f321a7eb-78b4-4ce9-b5ea-dc1dade4921b, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '172bca2a-f8ea-4521-800d-b1528cf503d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:06:32.280214 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:32.352856 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] For port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:06:32.356673 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] For port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:06:32.361810 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:32.370249 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:30Z', 'revision_number': 3, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:30Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:32.400497 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:32.401588 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:32.402569 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Checking router: 983dc48a-7f67-4eed-9560-9f50c5b92a36 for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:06:32.402925 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Updating router 983dc48a-7f67-4eed-9560-9f50c5b92a36 port d55b1a8d-8a79-43d6-8747-4bd1a56c7584 binding host dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 17:06:32.403149 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] 10.222.0.69 "PUT /v2.0/ports/f321a7eb-78b4-4ce9-b5ea-dc1dade4921b HTTP/1.1" status: 200 len: 1093 time: 0.9009709 Sep 01 17:06:32.404049 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'tag': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:06:32.406322 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a703bd23-edc8-4eb2-9766-bd5d5986c700" -d '{"events": [{"name": "network-changed", "server_uuid": "9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89", "tag": "f321a7eb-78b4-4ce9-b5ea-dc1dade4921b"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:06:32.425136 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9d3d18f1-b2c5-406b-86cc-3514ecbe48f3 req-352fecd6-4df0-45a4-8862-27934e98fef7 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1185794 Sep 01 17:06:32.442826 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee3447f-73b3-4e4d-836c-3ecb8a575bef req-6764dd4e-d04c-404f-ab7b-60839e3f9792 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:32.452488 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fee3447f-73b3-4e4d-836c-3ecb8a575bef req-6764dd4e-d04c-404f-ab7b-60839e3f9792 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 943 time: 0.1439197 Sep 01 17:06:32.458492 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:32.504511 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:06:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c05314b-5c28-4b3d-b0a5-e6119ef280ac x-openstack-request-id: req-0c05314b-5c28-4b3d-b0a5-e6119ef280ac {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:06:32.504853 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89", "tag": "f321a7eb-78b4-4ce9-b5ea-dc1dade4921b", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:06:32.505206 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-0c05314b-5c28-4b3d-b0a5-e6119ef280ac {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:06:32.505918 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'tag': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b', 'status': 'completed', 'code': 200} Sep 01 17:06:32.509485 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d161c9-846c-4641-9f43-982bde6ea144 service neutron] Pushing event updated for resources: {'Port': ['ID=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:32.531251 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-8ec87276-689c-466e-b921-7fba955de61f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:32.537243 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-8ec87276-689c-466e-b921-7fba955de61f service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 1096 time: 0.0928996 Sep 01 17:06:32.562237 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fee3447f-73b3-4e4d-836c-3ecb8a575bef req-5dd580a7-7ee8-4fbe-aae6-ce506d63de37 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1037831 Sep 01 17:06:32.595912 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 75fbd6de-c7da-4bed-8fb8-60e2230aca29 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:06:32.631272 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-0744ee06-05ce-41c6-b372-a5f7e5ab8725 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b HTTP/1.1" status: 200 len: 217 time: 0.0813215 Sep 01 17:06:32.653190 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 75fbd6de-c7da-4bed-8fb8-60e2230aca29 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:06:32.653863 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:32.696650 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-73359580-a777-4f98-bd8a-71a4f0664196 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:32.698179 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-73359580-a777-4f98-bd8a-71a4f0664196 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 200 len: 850 time: 0.0580261 Sep 01 17:06:32.759722 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-2bd8980a-efa2-45ea-84bd-8980aa3113a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:32.761236 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-2bd8980a-efa2-45ea-84bd-8980aa3113a8 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=35c995f2-96ec-4a35-9f59-05221a09df3f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0529213 Sep 01 17:06:32.767531 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:32.863000 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-643807f2-124a-4e52-b064-55e50e0286f7 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0937967 Sep 01 17:06:32.865923 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Notify callbacks [] for port, precommit_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:32.876914 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.provisioning_blocks [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Transition to ACTIVE for port object d55b1a8d-8a79-43d6-8747-4bd1a56c7584 will not be triggered until provisioned by entity L2. {{(pid=93838) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:06:32.884236 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:32.931776 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Allocated IP 172.20.0.1 (adfcf065-5df4-4f7a-9b14-3f96b61d0c25/638b3e89-f5ce-4389-adde-079fe5b332cd/548dbdbe-f56b-4275-a3c7-8c0623662b05) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:06:32.946429 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b967e9e5-da35-4463-91e6-014fc991b95d None None] Pushing event updated for resources: {'Port': ['ID=d55b1a8d-8a79-43d6-8747-4bd1a56c7584,revision_number=2']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:32.949290 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Attempting to bind port d55b1a8d-8a79-43d6-8747-4bd1a56c7584 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:06:32.949898 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Attempting to bind port d55b1a8d-8a79-43d6-8747-4bd1a56c7584 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:06:32.950258 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Attempting to bind port d55b1a8d-8a79-43d6-8747-4bd1a56c7584 on network e28b8145-06a4-43a8-a9f2-9a7014f96a23 {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:06:32.959290 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b967e9e5-da35-4463-91e6-014fc991b95d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:32.959661 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b967e9e5-da35-4463-91e6-014fc991b95d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:32.960005 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b967e9e5-da35-4463-91e6-014fc991b95d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:32.960338 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b967e9e5-da35-4463-91e6-014fc991b95d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:32.960666 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b967e9e5-da35-4463-91e6-014fc991b95d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:32.960997 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b967e9e5-da35-4463-91e6-014fc991b95d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:32.961320 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b967e9e5-da35-4463-91e6-014fc991b95d None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:32.961669 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b967e9e5-da35-4463-91e6-014fc991b95d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:32.962008 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b967e9e5-da35-4463-91e6-014fc991b95d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:32.962335 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b967e9e5-da35-4463-91e6-014fc991b95d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:32.962652 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b967e9e5-da35-4463-91e6-014fc991b95d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:32.962969 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b967e9e5-da35-4463-91e6-014fc991b95d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93838) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:06:32.966509 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 6, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:06:32.966886 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Checking segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93838) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:06:32.967386 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:32.967768 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Bound using segment: {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'} {{(pid=93838) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:06:32.968417 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.managers [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Bound port: d55b1a8d-8a79-43d6-8747-4bd1a56c7584, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '74f97e23-9fdf-4c83-acaf-c3c8fafa1987', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}}] {{(pid=93838) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:06:32.968795 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:32.975931 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4bc4c162-00ba-4290-83e8-5ebec4e66a12 req-cdfd31b7-47dc-4bb7-bfd7-2ad246550c0c service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1012983 Sep 01 17:06:33.022669 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] For port d55b1a8d-8a79-43d6-8747-4bd1a56c7584, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93838) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:06:33.026165 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.plugins.ml2.db [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] For port d55b1a8d-8a79-43d6-8747-4bd1a56c7584, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=d55b1a8d-8a79-43d6-8747-4bd1a56c7584,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93838) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:06:33.031665 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron_lib.callbacks.manager [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93838) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:33.059682 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:33.075696 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.provisioning_blocks [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Transition to ACTIVE for port object 548dbdbe-f56b-4275-a3c7-8c0623662b05 will not be triggered until provisioned by entity DHCP. {{(pid=93836) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:06:33.079078 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a703bd23-edc8-4eb2-9766-bd5d5986c700 req-820b6167-d021-4a78-8213-a0156837755b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:33.080221 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a703bd23-edc8-4eb2-9766-bd5d5986c700 req-820b6167-d021-4a78-8213-a0156837755b service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 1096 time: 0.0526373 Sep 01 17:06:33.092792 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Routers {'983dc48a-7f67-4eed-9560-9f50c5b92a36'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:06:33.093276 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:06:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['983dc48a-7f67-4eed-9560-9f50c5b92a36'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:33.112481 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:33.139887 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b967e9e5-da35-4463-91e6-014fc991b95d None None] Pushing event updated for resources: {'Port': ['ID=d55b1a8d-8a79-43d6-8747-4bd1a56c7584,revision_number=3']} {{(pid=93838) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:33.151497 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:06:33.157275 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:06:33.159754 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:06:33.187880 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a703bd23-edc8-4eb2-9766-bd5d5986c700 req-63d9ee7e-de86-4da1-ad0f-f6313fb7d6cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:33.189441 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a703bd23-edc8-4eb2-9766-bd5d5986c700 req-63d9ee7e-de86-4da1-ad0f-f6313fb7d6cc service neutron] 10.222.0.69 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 912 time: 0.1017196 Sep 01 17:06:33.191117 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Pushing event updated for resources: {'Port': ['ID=548dbdbe-f56b-4275-a3c7-8c0623662b05,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:33.210832 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1827972'] for router_interface, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:33.224232 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] Set router 983dc48a-7f67-4eed-9560-9f50c5b92a36 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:06:33.242797 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a703bd23-edc8-4eb2-9766-bd5d5986c700 req-1531477c-a079-4726-9857-aee6bd19e00b service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b HTTP/1.1" status: 200 len: 217 time: 0.0452545 Sep 01 17:06:33.308746 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a703bd23-edc8-4eb2-9766-bd5d5986c700 req-5972ebb4-3113-4bf9-aee3-ae35b8a90e14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:33.310464 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a703bd23-edc8-4eb2-9766-bd5d5986c700 req-5972ebb4-3113-4bf9-aee3-ae35b8a90e14 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 200 len: 850 time: 0.0584350 Sep 01 17:06:33.361100 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a703bd23-edc8-4eb2-9766-bd5d5986c700 req-f51ca079-354b-485b-b982-03ef045d3495 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:33.362787 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a703bd23-edc8-4eb2-9766-bd5d5986c700 req-f51ca079-354b-485b-b982-03ef045d3495 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=35c995f2-96ec-4a35-9f59-05221a09df3f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0431249 Sep 01 17:06:33.365340 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:33.437774 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:30Z', 'revision_number': 3, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:33.439439 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-d78a5e85-6ffd-49ac-82d0-ab7c1ecb8f37 None None] Provisioning for port 548dbdbe-f56b-4275-a3c7-8c0623662b05 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:06:33.449124 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-d78a5e85-6ffd-49ac-82d0-ab7c1ecb8f37 None None] Provisioning complete for port 548dbdbe-f56b-4275-a3c7-8c0623662b05 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:06:33.449935 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-d78a5e85-6ffd-49ac-82d0-ab7c1ecb8f37 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:33.493043 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-d78a5e85-6ffd-49ac-82d0-ab7c1ecb8f37 None None] Port 548dbdbe-f56b-4275-a3c7-8c0623662b05 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:06:33.498196 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47ee07b8-26f4-4031-9462-5f63273f26ea None None] The sync data for ids ['983dc48a-7f67-4eed-9560-9f50c5b92a36'] in dv-cinder-799668-16-iscsi is: [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:30Z', 'revision_number': 3, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:06:33.498765 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a703bd23-edc8-4eb2-9766-bd5d5986c700 req-2a812504-813d-47f9-88ba-74a8ee5fd01d service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1204767 Sep 01 17:06:33.611294 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-626d21ad-d1f9-4fac-8e90-0810055c301e req-7807c4bb-dfdc-433c-8c67-acd7750f0aab tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:33.618946 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-626d21ad-d1f9-4fac-8e90-0810055c301e req-7807c4bb-dfdc-433c-8c67-acd7750f0aab tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0922832 Sep 01 17:06:33.621480 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f81f109-d1e9-43ad-8008-829b8ab47391 req-7d8de998-b0be-4a5e-ba62-25755e7e49b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:33.623012 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5f81f109-d1e9-43ad-8008-829b8ab47391 req-7d8de998-b0be-4a5e-ba62-25755e7e49b2 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=59475fb517464851810daf1967046d0c&device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 1098 time: 0.0989273 Sep 01 17:06:33.644389 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Notify callbacks [] for port, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:33.655455 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6279726'] for port, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:33.701671 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a703bd23-edc8-4eb2-9766-bd5d5986c700 req-e90be369-36ff-42f9-b31c-7828f53d40fe service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1785915 Sep 01 17:06:33.736962 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-626d21ad-d1f9-4fac-8e90-0810055c301e req-2148f954-82a8-4add-8c2e-2d353df1df5f tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1110065 Sep 01 17:06:33.781837 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f81f109-d1e9-43ad-8008-829b8ab47391 req-ad764aa2-c35c-4c99-9fbe-ac23a97d42d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:33.784455 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5f81f109-d1e9-43ad-8008-829b8ab47391 req-ad764aa2-c35c-4c99-9fbe-ac23a97d42d0 service neutron] 10.222.0.69 "GET /v2.0/networks?id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f HTTP/1.1" status: 200 len: 910 time: 0.1352561 Sep 01 17:06:33.803266 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Pushing event updated for resources: {'Port': ['ID=548dbdbe-f56b-4275-a3c7-8c0623662b05,revision_number=2']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:33.806460 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611336', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1832500'] for router_interface, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:33.833025 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea4d266-ba86-4f38-a681-83225dd3bb6b req-c8026df8-31e0-455b-a5a7-7c24e8f6f83c tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:33.835520 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cea4d266-ba86-4f38-a681-83225dd3bb6b req-c8026df8-31e0-455b-a5a7-7c24e8f6f83c tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 943 time: 0.1632943 Sep 01 17:06:33.867465 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5f81f109-d1e9-43ad-8008-829b8ab47391 req-e302ec33-4823-4723-9baa-9b9cc8d469bf service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=aec9941f-617a-4d03-a98b-27c5fea3c635 HTTP/1.1" status: 200 len: 1001 time: 0.0741358 Sep 01 17:06:33.929711 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f81f109-d1e9-43ad-8008-829b8ab47391 req-2af73d3e-fe47-454e-a2b8-afee3eff1fb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:33.931890 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5f81f109-d1e9-43ad-8008-829b8ab47391 req-2af73d3e-fe47-454e-a2b8-afee3eff1fb1 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=53347cb0-0e42-4047-9ec0-95b809608613 HTTP/1.1" status: 200 len: 848 time: 0.0562584 Sep 01 17:06:33.935615 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cea4d266-ba86-4f38-a681-83225dd3bb6b req-4ca0f64e-6769-4095-980f-8ea64af7e578 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0836654 Sep 01 17:06:33.960899 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:06:33.962404 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:06:33.991891 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f81f109-d1e9-43ad-8008-829b8ab47391 req-067fd1cb-c7f7-4882-96a0-5c9b42038851 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:33.993470 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5f81f109-d1e9-43ad-8008-829b8ab47391 req-067fd1cb-c7f7-4882-96a0-5c9b42038851 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0534630 Sep 01 17:06:34.094122 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Router 983dc48a-7f67-4eed-9560-9f50c5b92a36 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:06:34.118132 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5f81f109-d1e9-43ad-8008-829b8ab47391 req-8d632fa8-8566-4ff1-80e7-c6c319284e6e service neutron] 10.222.0.69 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1143994 Sep 01 17:06:34.219513 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-518ea4ef-6a80-4932-af72-a12f54bdf48c None None] Provisioning complete for port 548dbdbe-f56b-4275-a3c7-8c0623662b05 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:06:34.220284 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-518ea4ef-6a80-4932-af72-a12f54bdf48c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:34.234997 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5f81f109-d1e9-43ad-8008-829b8ab47391 req-9e598608-1277-40a9-8ecb-108fdf235a2a service neutron] 10.222.0.69 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1085143 Sep 01 17:06:34.260461 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-518ea4ef-6a80-4932-af72-a12f54bdf48c None None] Port 548dbdbe-f56b-4275-a3c7-8c0623662b05 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:06:34.471000 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:06:34.476160 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-e02e2b81-4fff-4426-af12-5f25c6ad220b admin admin] 10.222.0.67 "PUT /v2.0/routers/983dc48a-7f67-4eed-9560-9f50c5b92a36/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4690888 Sep 01 17:06:34.603119 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device d55b1a8d-8a79-43d6-8747-4bd1a56c7584 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:06:34.655596 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port d55b1a8d-8a79-43d6-8747-4bd1a56c7584 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:06:34.659832 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port d55b1a8d-8a79-43d6-8747-4bd1a56c7584 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:06:34.660213 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:34.743674 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:34.768042 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port d55b1a8d-8a79-43d6-8747-4bd1a56c7584, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=d55b1a8d-8a79-43d6-8747-4bd1a56c7584,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:34.772622 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:34.825886 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=d55b1a8d-8a79-43d6-8747-4bd1a56c7584,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:34.849184 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-750c622b-8a94-4c64-9200-f88be6d2ddc3 req-aa3dfc3b-e469-4b78-bf9c-10c48f2862d8 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:34.850640 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-750c622b-8a94-4c64-9200-f88be6d2ddc3 req-aa3dfc3b-e469-4b78-bf9c-10c48f2862d8 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0509608 Sep 01 17:06:34.894036 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-750c622b-8a94-4c64-9200-f88be6d2ddc3 req-7dca11cd-4f66-49c6-8f5e-a40555643429 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0367014 Sep 01 17:06:35.013330 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60626) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:35.019328 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-bc4540bb-5105-481d-bb06-2cd9585d0158 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Request body: {'security_group': {'name': 'tempest-securitygroup--795039609', 'description': 'tempest-description--1928714179'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:06:35.043393 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bc4540bb-5105-481d-bb06-2cd9585d0158 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.068148 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aea8d6f-7c1f-4700-8d17-8a7a5bf8d1d5 req-a9bb0f3f-82cb-482c-8432-0c9a18fb27b4 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:35.069701 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2aea8d6f-7c1f-4700-8d17-8a7a5bf8d1d5 req-a9bb0f3f-82cb-482c-8432-0c9a18fb27b4 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 943 time: 0.0605731 Sep 01 17:06:35.111524 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2aea8d6f-7c1f-4700-8d17-8a7a5bf8d1d5 req-631eca7c-a087-47ea-8613-0f7383c15856 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0356350 Sep 01 17:06:35.129732 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bc4540bb-5105-481d-bb06-2cd9585d0158 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.133803 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bc4540bb-5105-481d-bb06-2cd9585d0158 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.160402 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-bc4540bb-5105-481d-bb06-2cd9585d0158 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.161633 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-bc4540bb-5105-481d-bb06-2cd9585d0158 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.1472380 Sep 01 17:06:35.164625 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60628) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:35.165521 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc4540bb-5105-481d-bb06-2cd9585d0158 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ebc44224-604f-486e-a008-5a58b91c7eb6,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:35.172070 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-772f5f35-c13e-463f-8246-443d01490f53 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Request body: {'security_group_rule': {'security_group_id': 'ebc44224-604f-486e-a008-5a58b91c7eb6', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:06:35.200290 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-772f5f35-c13e-463f-8246-443d01490f53 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.223719 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Sync routers for ids ['983dc48a-7f67-4eed-9560-9f50c5b92a36'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:06:35.232896 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Routers {'983dc48a-7f67-4eed-9560-9f50c5b92a36'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:06:35.233616 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:06:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['983dc48a-7f67-4eed-9560-9f50c5b92a36'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:35.246732 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-772f5f35-c13e-463f-8246-443d01490f53 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.250718 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-772f5f35-c13e-463f-8246-443d01490f53 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.275812 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-772f5f35-c13e-463f-8246-443d01490f53 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=46cb399e-2611-4fdc-b9ad-2d79282aba6a,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:35.281931 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-772f5f35-c13e-463f-8246-443d01490f53 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.283172 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-772f5f35-c13e-463f-8246-443d01490f53 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1174912 Sep 01 17:06:35.286126 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60630) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:35.290697 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-9bf577ca-0b83-4753-8e5b-c09269778458 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Request body: {'security_group_rule': {'security_group_id': 'ebc44224-604f-486e-a008-5a58b91c7eb6', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:06:35.316845 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9bf577ca-0b83-4753-8e5b-c09269778458 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.354223 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Set router 983dc48a-7f67-4eed-9560-9f50c5b92a36 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:06:35.374409 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9bf577ca-0b83-4753-8e5b-c09269778458 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.379648 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9bf577ca-0b83-4753-8e5b-c09269778458 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.399303 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bf577ca-0b83-4753-8e5b-c09269778458 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=26be459d-364e-4236-8ff9-803014ea0713,revision_number=0']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:35.408268 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-9bf577ca-0b83-4753-8e5b-c09269778458 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.409708 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-9bf577ca-0b83-4753-8e5b-c09269778458 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1225226 Sep 01 17:06:35.412622 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60632) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:35.417963 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Request body: {'floatingip': {'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:06:35.443375 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for floatingip, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.544033 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.558643 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 2, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:35.587694 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Checking router: 983dc48a-7f67-4eed-9560-9f50c5b92a36 for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:06:35.588055 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Updating router 983dc48a-7f67-4eed-9560-9f50c5b92a36 port 548dbdbe-f56b-4275-a3c7-8c0623662b05 binding host dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 01 17:06:35.613865 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.656074 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Allocated IP 172.27.1.146 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/a7feaca6-324a-47e0-b087-6189b8634dd4) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:06:35.759640 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.801377 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.841598 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:06:35.847233 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:06:35.851484 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:06:35.854516 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event updated for resources: {'Port': ['ID=a7feaca6-324a-47e0-b087-6189b8634dd4,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:35.879593 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Notify callbacks [] for port, precommit_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.890203 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Transition to ACTIVE for port object 548dbdbe-f56b-4275-a3c7-8c0623662b05 will not be triggered until provisioned by entity L2. {{(pid=93837) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:06:35.895725 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:35.946114 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff82e0db-476f-4010-9233-d7e56b034281 None None] Pushing event updated for resources: {'Port': ['ID=548dbdbe-f56b-4275-a3c7-8c0623662b05,revision_number=3']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:36.010020 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Attempting to bind port 548dbdbe-f56b-4275-a3c7-8c0623662b05 on host dv-cinder-799668-16-iscsi for vnic_type normal with profile {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:06:36.010710 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Attempting to bind port 548dbdbe-f56b-4275-a3c7-8c0623662b05 by drivers openvswitch,hyperv on host dv-cinder-799668-16-iscsi at level 0 using segments [{'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:06:36.011298 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Attempting to bind port 548dbdbe-f56b-4275-a3c7-8c0623662b05 on network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:06:36.017784 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Checking agent: {'id': '83445119-cd28-4619-81eb-0769de00010e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799668-16-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 50, 24), 'started_at': datetime.datetime(2021, 9, 1, 16, 50, 54), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 6, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799668-16-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:06:36.019008 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Checking segment: {'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93837) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:06:36.019008 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:36.019430 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Bound using segment: {'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'} {{(pid=93837) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:06:36.020100 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.managers [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Bound port: 548dbdbe-f56b-4275-a3c7-8c0623662b05, host: dv-cinder-799668-16-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'}}] {{(pid=93837) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:06:36.021527 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:36.030054 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-015630c0-cea8-44fc-8f43-898ffc53e45c req-70936bf3-8db3-49ce-9793-c0b453c08c3f tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:36.036483 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-015630c0-cea8-44fc-8f43-898ffc53e45c req-70936bf3-8db3-49ce-9793-c0b453c08c3f tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0655012 Sep 01 17:06:36.081744 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-015630c0-cea8-44fc-8f43-898ffc53e45c req-4f2346d6-5bea-4e70-b6e2-25e05bfc256e tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0380046 Sep 01 17:06:36.107387 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] For port 548dbdbe-f56b-4275-a3c7-8c0623662b05, host dv-cinder-799668-16-iscsi, cleared binding levels {{(pid=93837) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:06:36.111349 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] For port 548dbdbe-f56b-4275-a3c7-8c0623662b05, host dv-cinder-799668-16-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=548dbdbe-f56b-4275-a3c7-8c0623662b05,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93837) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:06:36.116923 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:36.199567 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Routers {'983dc48a-7f67-4eed-9560-9f50c5b92a36'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:06:36.200026 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:06:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['983dc48a-7f67-4eed-9560-9f50c5b92a36'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:36.205543 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff82e0db-476f-4010-9233-d7e56b034281 None None] Pushing event updated for resources: {'Port': ['ID=548dbdbe-f56b-4275-a3c7-8c0623662b05,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:36.239441 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:36.261301 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d4d8dd-65d8-4098-bf23-25272ee42900 req-5fbbc8af-c844-4e7a-a2df-a7be7ed01865 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:36.262895 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-63d4d8dd-65d8-4098-bf23-25272ee42900 req-5fbbc8af-c844-4e7a-a2df-a7be7ed01865 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 943 time: 0.0570211 Sep 01 17:06:36.286766 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:36.317496 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-63d4d8dd-65d8-4098-bf23-25272ee42900 req-63e4c9b5-532b-4660-b356-e02c7808bc6c tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419240 Sep 01 17:06:36.453989 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:36.458615 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:36.460950 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] Set router 983dc48a-7f67-4eed-9560-9f50c5b92a36 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:06:36.537902 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event updated for resources: {'Port': ['ID=a7feaca6-324a-47e0-b087-6189b8634dd4,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:36.552191 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:36.566501 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:36.572111 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-57124de9-fa2c-4390-9952-18514d92b895 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.1541727 Sep 01 17:06:36.591275 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device d55b1a8d-8a79-43d6-8747-4bd1a56c7584 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:06:36.686698 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port d55b1a8d-8a79-43d6-8747-4bd1a56c7584 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:06:36.687367 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:36.708076 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-47a8ef17-9082-4a1f-bf0b-bd99b0f740fc tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?name=tempest-securitygroup--795039609&fields=id&tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c HTTP/1.1" status: 200 len: 267 time: 0.0322773 Sep 01 17:06:36.745844 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:36Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:36.773967 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24e47fb5-be29-4f97-8d22-14d461e92ab3 None None] The sync data for ids ['983dc48a-7f67-4eed-9560-9f50c5b92a36'] in dv-cinder-799668-16-iscsi is: [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:36Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:06:36.834074 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-26aeceb4-34c0-4fbb-8c3a-26b4fed01ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:36.835845 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-26aeceb4-34c0-4fbb-8c3a-26b4fed01ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/networks?id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25 HTTP/1.1" status: 200 len: 811 time: 0.1210492 Sep 01 17:06:36.853896 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-973a7c1e-6527-4010-8637-77da9b1feecb tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/quotas/aef2053b969d4ca58b0e1ec3a7e7a06c HTTP/1.1" status: 200 len: 375 time: 0.0115814 Sep 01 17:06:36.910305 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-0c6ca058-6250-4532-99fa-f33bff699cb6 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0502899 Sep 01 17:06:37.015088 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-8c9dd482-1085-4bef-be27-cd91380d03d7 service neutron] 10.222.0.67 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0927141 Sep 01 17:06:37.107637 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-7be8f8e6-c013-4cc9-b4f3-dddb0a44cf06 service neutron] 10.222.0.67 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863941 Sep 01 17:06:37.199930 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87567558-5f15-4a26-96da-d8904bf54f50 req-e9ebee6b-b8c2-4f4d-b708-2150d79e5930 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:37.208088 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-87567558-5f15-4a26-96da-d8904bf54f50 req-e9ebee6b-b8c2-4f4d-b708-2150d79e5930 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0581741 Sep 01 17:06:37.252042 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-87567558-5f15-4a26-96da-d8904bf54f50 req-d3bd9878-0038-4de5-888f-bb96d752cab0 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0430560 Sep 01 17:06:37.310090 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-14eae7a7-e276-416c-a7bf-7a0f5ee9d8d1 req-069b8e31-428e-4bf8-b8ee-808f555edeef tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 210 time: 0.0313604 Sep 01 17:06:37.464385 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08dbdf35-2ac1-47b3-ac8e-763dc8004f8f req-b1e6e2f3-a1b6-4fff-8829-e9e775ab50c1 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:37.465847 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-08dbdf35-2ac1-47b3-ac8e-763dc8004f8f req-b1e6e2f3-a1b6-4fff-8829-e9e775ab50c1 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 943 time: 0.0590141 Sep 01 17:06:37.509184 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-08dbdf35-2ac1-47b3-ac8e-763dc8004f8f req-027c5829-1fa0-4168-abaa-9631df1f063e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0362203 Sep 01 17:06:38.367635 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59c76452-2245-49a9-9aed-336fa24c3218 req-7e01ec6f-36c5-4a89-bbfc-1949099abdbf tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:38.372698 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-59c76452-2245-49a9-9aed-336fa24c3218 req-7e01ec6f-36c5-4a89-bbfc-1949099abdbf tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0524194 Sep 01 17:06:38.413236 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-91e854aa-1ac4-4c5d-a0d1-48514c007823 req-83b30ebc-6cfb-4be5-88b3-c5f3d9f842a0 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 210 time: 0.0304546 Sep 01 17:06:38.431144 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-59c76452-2245-49a9-9aed-336fa24c3218 req-3ac90813-83b1-4084-89fb-b40765e7b241 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0548549 Sep 01 17:06:38.580958 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c78751d-ef64-4700-adc7-c9ebc733f2e3 req-57159b83-404e-456a-bd4b-5888e78dabaa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:38.582516 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2c78751d-ef64-4700-adc7-c9ebc733f2e3 req-57159b83-404e-456a-bd4b-5888e78dabaa service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=59475fb517464851810daf1967046d0c&device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 1098 time: 0.0726178 Sep 01 17:06:38.635478 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 548dbdbe-f56b-4275-a3c7-8c0623662b05 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:06:38.653957 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5616dd70-995f-4fb6-b11a-4148fe721d5e req-0ee00126-598c-4193-9ba9-34201fdf0464 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:38.656154 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5616dd70-995f-4fb6-b11a-4148fe721d5e req-0ee00126-598c-4193-9ba9-34201fdf0464 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 943 time: 0.0598783 Sep 01 17:06:38.656925 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-e35ddedb-2af0-429f-adfd-ab47a7832211 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:38.658457 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-e35ddedb-2af0-429f-adfd-ab47a7832211 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.69 "GET /v2.0/networks?id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25 HTTP/1.1" status: 200 len: 811 time: 0.1942067 Sep 01 17:06:38.690981 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning for port 548dbdbe-f56b-4275-a3c7-8c0623662b05 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:06:38.694848 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 548dbdbe-f56b-4275-a3c7-8c0623662b05 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:06:38.695328 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:38.702977 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5616dd70-995f-4fb6-b11a-4148fe721d5e req-e69de1af-1907-4f9a-86c0-23a782c722b7 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387118 Sep 01 17:06:38.739810 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-a553d9bc-8c16-4f1b-8deb-b49d02bc0864 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c HTTP/1.1" status: 200 len: 379 time: 0.0594194 Sep 01 17:06:38.740832 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c78751d-ef64-4700-adc7-c9ebc733f2e3 req-d4358b20-793e-4af2-8845-69ce62d8a7bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:38.742245 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2c78751d-ef64-4700-adc7-c9ebc733f2e3 req-d4358b20-793e-4af2-8845-69ce62d8a7bc service neutron] 10.222.0.69 "GET /v2.0/networks?id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f HTTP/1.1" status: 200 len: 910 time: 0.1504061 Sep 01 17:06:38.762979 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5872b41c-d152-4f53-a8ef-db879ad6cf24 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Request body: {'port': {'device_id': 'e47e85e5-f5f1-45ff-aad0-1c58527b7712', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'admin_state_up': True, 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'security_groups': ['ebc44224-604f-486e-a008-5a58b91c7eb6']}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:06:38.774505 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:38.806849 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] For port 548dbdbe-f56b-4275-a3c7-8c0623662b05, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=548dbdbe-f56b-4275-a3c7-8c0623662b05,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:38.811651 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:38.858802 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Pushing event updated for resources: {'Port': ['ID=548dbdbe-f56b-4275-a3c7-8c0623662b05,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:38.876622 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2c78751d-ef64-4700-adc7-c9ebc733f2e3 req-41dc61bf-dc7b-4767-b063-927de72fcf9b service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=aec9941f-617a-4d03-a98b-27c5fea3c635 HTTP/1.1" status: 200 len: 1001 time: 0.1223600 Sep 01 17:06:38.958825 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c78751d-ef64-4700-adc7-c9ebc733f2e3 req-d059a1ba-4304-4d6c-81d1-1a4d83c2bc6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:38.960286 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2c78751d-ef64-4700-adc7-c9ebc733f2e3 req-d059a1ba-4304-4d6c-81d1-1a4d83c2bc6f service neutron] 10.222.0.69 "GET /v2.0/subnets?id=53347cb0-0e42-4047-9ec0-95b809608613 HTTP/1.1" status: 200 len: 848 time: 0.0729024 Sep 01 17:06:38.976857 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5872b41c-d152-4f53-a8ef-db879ad6cf24 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Made reservation on behalf of aef2053b969d4ca58b0e1ec3a7e7a06c for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:06:38.980158 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5872b41c-d152-4f53-a8ef-db879ad6cf24 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:39.064432 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c78751d-ef64-4700-adc7-c9ebc733f2e3 req-dba326a6-1b97-4aa5-a920-5ed205902db8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:39.066018 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2c78751d-ef64-4700-adc7-c9ebc733f2e3 req-dba326a6-1b97-4aa5-a920-5ed205902db8 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0978379 Sep 01 17:06:39.194866 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5872b41c-d152-4f53-a8ef-db879ad6cf24 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Allocated IP 172.20.0.13 (adfcf065-5df4-4f7a-9b14-3f96b61d0c25/638b3e89-f5ce-4389-adde-079fe5b332cd/bb2db631-7e1f-45bc-b23c-b3e3181a12ab) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:06:39.218981 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2c78751d-ef64-4700-adc7-c9ebc733f2e3 req-6e1d6b1e-7c04-4cb1-b08b-c4fbfedf310a service neutron] 10.222.0.69 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1391287 Sep 01 17:06:39.386184 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-2c78751d-ef64-4700-adc7-c9ebc733f2e3 req-114c5731-0888-47e8-a6fd-1f87e6061653 service neutron] 10.222.0.69 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1595459 Sep 01 17:06:39.413418 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5872b41c-d152-4f53-a8ef-db879ad6cf24 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:39.431217 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5872b41c-d152-4f53-a8ef-db879ad6cf24 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Transition to ACTIVE for port object bb2db631-7e1f-45bc-b23c-b3e3181a12ab will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:06:39.464462 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5872b41c-d152-4f53-a8ef-db879ad6cf24 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:39.511673 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5872b41c-d152-4f53-a8ef-db879ad6cf24 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:06:39.515121 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5872b41c-d152-4f53-a8ef-db879ad6cf24 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:06:39.519019 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5872b41c-d152-4f53-a8ef-db879ad6cf24 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:06:39.546369 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5872b41c-d152-4f53-a8ef-db879ad6cf24 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event updated for resources: {'Port': ['ID=bb2db631-7e1f-45bc-b23c-b3e3181a12ab,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:39.570089 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4182326a-78df-4cd5-8811-e09ae392ecfe req-33013ba4-b9d1-4768-88d3-b75b7cdda1d1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:39.571679 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4182326a-78df-4cd5-8811-e09ae392ecfe req-33013ba4-b9d1-4768-88d3-b75b7cdda1d1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 932 time: 0.0877163 Sep 01 17:06:39.585321 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5872b41c-d152-4f53-a8ef-db879ad6cf24 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:39.585985 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5872b41c-d152-4f53-a8ef-db879ad6cf24 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:39.586479 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36914e0-7084-4334-aa54-476342cfbc5c req-3048b71c-5344-4452-9d94-4bf74385140d tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:39.588032 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e36914e0-7084-4334-aa54-476342cfbc5c req-3048b71c-5344-4452-9d94-4bf74385140d tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0735881 Sep 01 17:06:39.604296 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5872b41c-d152-4f53-a8ef-db879ad6cf24 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8508317 Sep 01 17:06:39.620340 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Request body: {'port': {'device_id': 'e47e85e5-f5f1-45ff-aad0-1c58527b7712', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:06:39.644695 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4182326a-78df-4cd5-8811-e09ae392ecfe req-7f239752-1ecf-47bc-8c79-23e72e0691b4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0666578 Sep 01 17:06:39.662193 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e36914e0-7084-4334-aa54-476342cfbc5c req-2357c30b-5390-4ea0-ab07-e96121f2b19e tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0603178 Sep 01 17:06:39.691907 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:39.806344 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-05fd8338-9f81-49eb-97c5-754d1ca8926e None None] Provisioning for port bb2db631-7e1f-45bc-b23c-b3e3181a12ab completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:06:39.811646 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-05fd8338-9f81-49eb-97c5-754d1ca8926e None None] Provisioning complete for port bb2db631-7e1f-45bc-b23c-b3e3181a12ab triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:06:39.812330 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-05fd8338-9f81-49eb-97c5-754d1ca8926e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:39.826289 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cfe1dc9-6bbe-44d6-babe-6dc52a86a6cf req-896fd28c-adbd-4396-a625-243fd5c46b28 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:39.828890 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2cfe1dc9-6bbe-44d6-babe-6dc52a86a6cf req-896fd28c-adbd-4396-a625-243fd5c46b28 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 943 time: 0.0531528 Sep 01 17:06:39.848838 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-05fd8338-9f81-49eb-97c5-754d1ca8926e None None] Port bb2db631-7e1f-45bc-b23c-b3e3181a12ab cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:06:39.869079 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2cfe1dc9-6bbe-44d6-babe-6dc52a86a6cf req-52bd45bd-c3db-4c12-bb10-a8c13e71b514 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0343094 Sep 01 17:06:39.963681 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bb2db631-7e1f-45bc-b23c-b3e3181a12ab {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:06:39.971715 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:39.983226 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Transition to ACTIVE for port object bb2db631-7e1f-45bc-b23c-b3e3181a12ab will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:06:39.987155 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:40.056217 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Pushing event updated for resources: {'Port': ['ID=bb2db631-7e1f-45bc-b23c-b3e3181a12ab,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:40.105408 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Attempting to bind port bb2db631-7e1f-45bc-b23c-b3e3181a12ab on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:06:40.105759 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Attempting to bind port bb2db631-7e1f-45bc-b23c-b3e3181a12ab by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:06:40.106095 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Attempting to bind port bb2db631-7e1f-45bc-b23c-b3e3181a12ab on network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:06:40.110773 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Port bb2db631-7e1f-45bc-b23c-b3e3181a12ab on network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:06:40.111104 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Attempting to bind port bb2db631-7e1f-45bc-b23c-b3e3181a12ab on network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:06:40.116313 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 6, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:06:40.116660 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Checking segment: {'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:06:40.117053 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Bound using segment: {'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:06:40.117520 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Bound port: bb2db631-7e1f-45bc-b23c-b3e3181a12ab, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:06:40.117888 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:40.187765 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] For port bb2db631-7e1f-45bc-b23c-b3e3181a12ab, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:06:40.191252 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] For port bb2db631-7e1f-45bc-b23c-b3e3181a12ab, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=bb2db631-7e1f-45bc-b23c-b3e3181a12ab,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:06:40.194700 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:40.226924 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:40.227533 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:40.228911 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] 10.222.0.69 "PUT /v2.0/ports/bb2db631-7e1f-45bc-b23c-b3e3181a12ab HTTP/1.1" status: 200 len: 1094 time: 0.6130660 Sep 01 17:06:40.229335 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e47e85e5-f5f1-45ff-aad0-1c58527b7712', 'tag': 'bb2db631-7e1f-45bc-b23c-b3e3181a12ab'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:06:40.232487 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-44f49b39-b6d4-4750-9755-4c4d23d099a3" -d '{"events": [{"name": "network-changed", "server_uuid": "e47e85e5-f5f1-45ff-aad0-1c58527b7712", "tag": "bb2db631-7e1f-45bc-b23c-b3e3181a12ab"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:06:40.260297 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41fc64b9-7d29-457b-9e57-6c8ac886a0f9 service neutron] Pushing event updated for resources: {'Port': ['ID=bb2db631-7e1f-45bc-b23c-b3e3181a12ab,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:40.281951 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:06:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f7882900-1cf7-48cc-9e31-1ef3e883d2ba x-openstack-request-id: req-f7882900-1cf7-48cc-9e31-1ef3e883d2ba {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:06:40.282236 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e47e85e5-f5f1-45ff-aad0-1c58527b7712", "tag": "bb2db631-7e1f-45bc-b23c-b3e3181a12ab", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:06:40.282485 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-f7882900-1cf7-48cc-9e31-1ef3e883d2ba {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:06:40.282881 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e47e85e5-f5f1-45ff-aad0-1c58527b7712', 'tag': 'bb2db631-7e1f-45bc-b23c-b3e3181a12ab', 'status': 'completed', 'code': 200} Sep 01 17:06:40.327120 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5da9ca4d-0849-4963-9964-44a6154a2880 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:40.329212 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-5da9ca4d-0849-4963-9964-44a6154a2880 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c&device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 1097 time: 0.0446870 Sep 01 17:06:40.377149 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-f664c2ec-e76b-45aa-b403-983522f54f7c service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=bb2db631-7e1f-45bc-b23c-b3e3181a12ab HTTP/1.1" status: 200 len: 217 time: 0.0392742 Sep 01 17:06:40.428521 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-bd17bc51-fe30-4f76-9219-6b4feb1af0a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:40.430009 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-bd17bc51-fe30-4f76-9219-6b4feb1af0a1 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=638b3e89-f5ce-4389-adde-079fe5b332cd HTTP/1.1" status: 200 len: 850 time: 0.0452585 Sep 01 17:06:40.483992 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-affe3ebf-59cb-43b9-a8e5-c228db009cc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:40.484919 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-affe3ebf-59cb-43b9-a8e5-c228db009cc4 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0408797 Sep 01 17:06:40.574769 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 548dbdbe-f56b-4275-a3c7-8c0623662b05 up at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:06:40.583143 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-8ca28883-58e7-4250-ab92-ab4ee6228518 service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0889812 Sep 01 17:06:40.621709 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Provisioning complete for port 548dbdbe-f56b-4275-a3c7-8c0623662b05 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:06:40.622085 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:40.679255 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-95d0c065-9968-482e-8c7d-bbff01e65551 req-8d36bc1f-4cdc-47da-8669-3f4d95825d81 service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850122 Sep 01 17:06:40.780682 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f49b39-b6d4-4750-9755-4c4d23d099a3 req-8ccf8283-5cf8-44d6-80fc-3059cb196a10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:40.782163 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-44f49b39-b6d4-4750-9755-4c4d23d099a3 req-8ccf8283-5cf8-44d6-80fc-3059cb196a10 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c&device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 1097 time: 0.0436265 Sep 01 17:06:40.790649 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a421509-07a7-4b93-90cd-0d7c0400713a req-5855e2e5-8ed2-4720-9208-2aee62fe5aec tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:40.792111 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6a421509-07a7-4b93-90cd-0d7c0400713a req-5855e2e5-8ed2-4720-9208-2aee62fe5aec tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 944 time: 0.0781393 Sep 01 17:06:40.804887 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fdc21a5-682d-471f-8a48-e4ad018fa2f5 req-c478b549-96a1-412d-ab89-5c282b1cb2f9 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:40.806358 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7fdc21a5-682d-471f-8a48-e4ad018fa2f5 req-c478b549-96a1-412d-ab89-5c282b1cb2f9 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0657928 Sep 01 17:06:40.866616 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7fdc21a5-682d-471f-8a48-e4ad018fa2f5 req-e47f3300-d0f1-42a8-8c72-1f581d300340 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0529344 Sep 01 17:06:40.869555 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6a421509-07a7-4b93-90cd-0d7c0400713a req-d09bdd67-1bc9-4ece-9820-b26dfd01a594 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0623186 Sep 01 17:06:40.878254 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f49b39-b6d4-4750-9755-4c4d23d099a3 req-b5304e9e-2f39-4b3c-9086-fbf4cd3574e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:40.879870 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-44f49b39-b6d4-4750-9755-4c4d23d099a3 req-b5304e9e-2f39-4b3c-9086-fbf4cd3574e6 service neutron] 10.222.0.69 "GET /v2.0/networks?id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25 HTTP/1.1" status: 200 len: 912 time: 0.0903440 Sep 01 17:06:40.927935 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-44f49b39-b6d4-4750-9755-4c4d23d099a3 req-e8f95c51-442e-47b5-84eb-71a460ba0d67 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=bb2db631-7e1f-45bc-b23c-b3e3181a12ab HTTP/1.1" status: 200 len: 217 time: 0.0375681 Sep 01 17:06:40.982098 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f49b39-b6d4-4750-9755-4c4d23d099a3 req-a51409d2-5d03-4f25-bf33-ed7100c3a4e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:40.984328 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-44f49b39-b6d4-4750-9755-4c4d23d099a3 req-a51409d2-5d03-4f25-bf33-ed7100c3a4e3 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=638b3e89-f5ce-4389-adde-079fe5b332cd HTTP/1.1" status: 200 len: 850 time: 0.0485616 Sep 01 17:06:40.987420 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b14b3ca-6e09-4073-9ade-0069f9f8ff50 req-7508fc6e-4c30-48a6-b8f1-0e592b979a05 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:40.988935 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2b14b3ca-6e09-4073-9ade-0069f9f8ff50 req-7508fc6e-4c30-48a6-b8f1-0e592b979a05 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 943 time: 0.0531697 Sep 01 17:06:41.032844 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-2b14b3ca-6e09-4073-9ade-0069f9f8ff50 req-0e1fc11f-ad51-47a7-811c-aef3e0a8a7ca tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375326 Sep 01 17:06:41.033575 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f49b39-b6d4-4750-9755-4c4d23d099a3 req-73d8a0c1-0b13-42e3-a3b2-0141cdcc5c37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:41.035081 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-44f49b39-b6d4-4750-9755-4c4d23d099a3 req-73d8a0c1-0b13-42e3-a3b2-0141cdcc5c37 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0423388 Sep 01 17:06:41.127398 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-44f49b39-b6d4-4750-9755-4c4d23d099a3 req-a28493a4-c073-4109-90ca-770da000ca81 service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823631 Sep 01 17:06:41.222565 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-44f49b39-b6d4-4750-9755-4c4d23d099a3 req-8f88007b-ce52-4c59-8a43-96eff3ef154d service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857446 Sep 01 17:06:41.389707 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device f321a7eb-78b4-4ce9-b5ea-dc1dade4921b details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:06:41.480678 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:41.491683 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'port_id': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b', 'mac_address': 'fa:16:3e:70:2d:c1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 511, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:06:41.527660 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:41.540623 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f321a7eb-78b4-4ce9-b5ea-dc1dade4921b {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:06:41.563335 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:41.567291 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:41.617281 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:41.867025 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['f321a7eb-78b4-4ce9-b5ea-dc1dade4921b'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:06:42.020807 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5135b142-2c8b-498b-a8fa-bac7cbb05fec req-b1283eda-82b1-4440-80a9-d465be9752de tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:42.022345 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5135b142-2c8b-498b-a8fa-bac7cbb05fec req-b1283eda-82b1-4440-80a9-d465be9752de tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0865133 Sep 01 17:06:42.031804 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a61639b-165a-4e90-b78d-e707c9d231c4 req-dfc45c73-aacc-4b75-a02b-83e83d46a015 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:42.033284 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3a61639b-165a-4e90-b78d-e707c9d231c4 req-dfc45c73-aacc-4b75-a02b-83e83d46a015 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 944 time: 0.0944047 Sep 01 17:06:42.100173 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5135b142-2c8b-498b-a8fa-bac7cbb05fec req-2adce07b-2ef3-46a8-b6f6-956589a03406 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0654006 Sep 01 17:06:42.107914 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3a61639b-165a-4e90-b78d-e707c9d231c4 req-3217e45f-b9a0-4ab5-b7e6-540fc32654d8 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0630465 Sep 01 17:06:42.215738 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-589bf47a-94a4-4dee-8797-1cbca8a85d82 req-94ce3cf6-68b6-4481-9cbd-6cdcc87b316e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:42.217909 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-589bf47a-94a4-4dee-8797-1cbca8a85d82 req-94ce3cf6-68b6-4481-9cbd-6cdcc87b316e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 944 time: 0.0491037 Sep 01 17:06:42.261700 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-589bf47a-94a4-4dee-8797-1cbca8a85d82 req-40b0b49b-68c9-4977-b7ca-5f7696b2f229 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374300 Sep 01 17:06:42.332092 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e407dca-5820-4b18-aaae-a9d57f237990 req-0241443e-0943-48c8-8ab4-9671a08fd828 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:42.333606 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8e407dca-5820-4b18-aaae-a9d57f237990 req-0241443e-0943-48c8-8ab4-9671a08fd828 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0525205 Sep 01 17:06:42.343805 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f319d572-a9fd-4a6c-99b3-45efe4cd4cd2 req-5b5db8e3-ee16-4a5c-b1c4-9b614e9dceae service neutron] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0905404 Sep 01 17:06:42.372996 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8e407dca-5820-4b18-aaae-a9d57f237990 req-2213350d-6512-421d-bb3c-b1185cd702ca tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0333114 Sep 01 17:06:43.236120 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-794ed78c-5905-4404-8932-a415d27afbfa req-e9bfa902-0acc-419a-812d-165bf7563dc1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:43.237905 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-794ed78c-5905-4404-8932-a415d27afbfa req-e9bfa902-0acc-419a-812d-165bf7563dc1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 944 time: 0.0556715 Sep 01 17:06:43.280303 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-794ed78c-5905-4404-8932-a415d27afbfa req-e06094bf-43f4-4b68-b85d-079cd3f0a37a tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0361013 Sep 01 17:06:43.381307 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c33b3eb8-72fa-4388-b03f-9f4507cd6701 req-efc653dc-5d2c-4256-a8b3-c83b2ac75f0f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:43.383204 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c33b3eb8-72fa-4388-b03f-9f4507cd6701 req-efc653dc-5d2c-4256-a8b3-c83b2ac75f0f tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 944 time: 0.0496981 Sep 01 17:06:43.394197 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device bb2db631-7e1f-45bc-b23c-b3e3181a12ab details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:06:43.397491 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device f321a7eb-78b4-4ce9-b5ea-dc1dade4921b up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:06:43.427002 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c33b3eb8-72fa-4388-b03f-9f4507cd6701 req-96e77210-30dc-49d1-a7f5-2a97ff2d07b1 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377417 Sep 01 17:06:43.493676 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3149a7aa-8901-4c3d-b2b0-d32438b81025 req-a8bdebb1-c68f-4b5b-8c8d-446381fc126b tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:43.495254 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3149a7aa-8901-4c3d-b2b0-d32438b81025 req-a8bdebb1-c68f-4b5b-8c8d-446381fc126b tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0489626 Sep 01 17:06:43.499497 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:06:43.507330 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:06:43.507705 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:43.534508 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3149a7aa-8901-4c3d-b2b0-d32438b81025 req-f8210357-9114-488e-8bff-789de776d0fb tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0322289 Sep 01 17:06:43.559753 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port bb2db631-7e1f-45bc-b23c-b3e3181a12ab, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=bb2db631-7e1f-45bc-b23c-b3e3181a12ab,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:43.573100 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'bb2db631-7e1f-45bc-b23c-b3e3181a12ab', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'port_id': 'bb2db631-7e1f-45bc-b23c-b3e3181a12ab', 'mac_address': 'fa:16:3e:75:21:2d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 527, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:06:43.609361 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f319d572-a9fd-4a6c-99b3-45efe4cd4cd2 req-fa85f9d5-e05c-4d80-96df-e8c4c5ca6b0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:43.610890 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f319d572-a9fd-4a6c-99b3-45efe4cd4cd2 req-fa85f9d5-e05c-4d80-96df-e8c4c5ca6b0b service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1&tenant_id=59475fb517464851810daf1967046d0c HTTP/1.1" status: 200 len: 1098 time: 0.0423286 Sep 01 17:06:43.646418 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:43.649378 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:43.667627 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bb2db631-7e1f-45bc-b23c-b3e3181a12ab {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:06:43.677308 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f319d572-a9fd-4a6c-99b3-45efe4cd4cd2 req-0be5f91c-ed10-454c-bec9-4e3a109abad8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:43.678838 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f319d572-a9fd-4a6c-99b3-45efe4cd4cd2 req-0be5f91c-ed10-454c-bec9-4e3a109abad8 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=59475fb517464851810daf1967046d0c&device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 1098 time: 0.0457528 Sep 01 17:06:43.693719 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:06:43.695961 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3ea20399-796a-4da3-ba2b-54f7528789a6" -d '{"events": [{"server_uuid": "9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89", "name": "network-vif-plugged", "status": "completed", "tag": "f321a7eb-78b4-4ce9-b5ea-dc1dade4921b"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:06:43.702873 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port bb2db631-7e1f-45bc-b23c-b3e3181a12ab, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=bb2db631-7e1f-45bc-b23c-b3e3181a12ab,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:43.711272 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:43.714049 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:43.745745 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:06:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fe96ce34-4ddb-46ea-a071-15f540cf213e x-openstack-request-id: req-fe96ce34-4ddb-46ea-a071-15f540cf213e {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:06:43.745976 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89", "name": "network-vif-plugged", "status": "completed", "tag": "f321a7eb-78b4-4ce9-b5ea-dc1dade4921b", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:06:43.746112 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-fe96ce34-4ddb-46ea-a071-15f540cf213e {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:06:43.746513 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b', 'code': 200} Sep 01 17:06:43.751036 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:43.781791 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=bb2db631-7e1f-45bc-b23c-b3e3181a12ab,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:43.791507 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f319d572-a9fd-4a6c-99b3-45efe4cd4cd2 req-5fb53ae1-f27a-4c4c-a53e-ee83dcca9551 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:43.792479 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f319d572-a9fd-4a6c-99b3-45efe4cd4cd2 req-5fb53ae1-f27a-4c4c-a53e-ee83dcca9551 service neutron] 10.222.0.69 "GET /v2.0/networks?id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f HTTP/1.1" status: 200 len: 910 time: 0.1051416 Sep 01 17:06:43.831232 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:43.868211 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f319d572-a9fd-4a6c-99b3-45efe4cd4cd2 req-29c8eda4-f340-4d87-bb06-f9336789493d service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=aec9941f-617a-4d03-a98b-27c5fea3c635 HTTP/1.1" status: 200 len: 1001 time: 0.0652082 Sep 01 17:06:43.925720 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f319d572-a9fd-4a6c-99b3-45efe4cd4cd2 req-0a0a7a03-7cb2-42c8-9513-bfa24ec0f5d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:43.927513 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f319d572-a9fd-4a6c-99b3-45efe4cd4cd2 req-0a0a7a03-7cb2-42c8-9513-bfa24ec0f5d8 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=53347cb0-0e42-4047-9ec0-95b809608613 HTTP/1.1" status: 200 len: 848 time: 0.0465202 Sep 01 17:06:44.001078 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['bb2db631-7e1f-45bc-b23c-b3e3181a12ab'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:06:44.023352 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f319d572-a9fd-4a6c-99b3-45efe4cd4cd2 req-d8f572e6-da28-4a26-8368-ee2f7076b223 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:44.024863 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f319d572-a9fd-4a6c-99b3-45efe4cd4cd2 req-d8f572e6-da28-4a26-8368-ee2f7076b223 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0797021 Sep 01 17:06:44.027502 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-310d9612-9d28-4689-8d7d-e529933ac9ee req-14c0d7d1-0732-4dc5-b1ba-1ced3a6beeec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:44.028849 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-310d9612-9d28-4689-8d7d-e529933ac9ee req-14c0d7d1-0732-4dc5-b1ba-1ced3a6beeec service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 1098 time: 0.0705023 Sep 01 17:06:44.129753 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-310d9612-9d28-4689-8d7d-e529933ac9ee req-54539dca-160b-44cb-9a3d-3c38938a8763 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0762537 Sep 01 17:06:44.160197 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f319d572-a9fd-4a6c-99b3-45efe4cd4cd2 req-f3c54309-4dc9-43d5-b068-c41f8881700c service neutron] 10.222.0.69 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1149127 Sep 01 17:06:44.396915 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eeceef3-2089-4148-af11-b2e44e6ee57a req-718676a0-7645-4bb5-97c2-03877714be2f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:44.398383 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8eeceef3-2089-4148-af11-b2e44e6ee57a req-718676a0-7645-4bb5-97c2-03877714be2f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 945 time: 0.0520444 Sep 01 17:06:44.430750 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-f319d572-a9fd-4a6c-99b3-45efe4cd4cd2 req-f015a192-744f-418c-8530-6731f9a98570 service neutron] 10.222.0.69 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0912857 Sep 01 17:06:44.437723 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8eeceef3-2089-4148-af11-b2e44e6ee57a req-3352ff73-73f2-4df7-a0bb-7d10217ce35a tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0331779 Sep 01 17:06:44.542301 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b6ada64-bffa-4f5b-9802-ba0760852aea req-c3e062d5-39bc-4a0e-9f79-06195847e28c tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:44.543781 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0b6ada64-bffa-4f5b-9802-ba0760852aea req-c3e062d5-39bc-4a0e-9f79-06195847e28c tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 945 time: 0.0493748 Sep 01 17:06:44.582919 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0b6ada64-bffa-4f5b-9802-ba0760852aea req-b7a1bc4e-8e63-41b4-a55f-394be1259bd8 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0324523 Sep 01 17:06:44.651321 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dbf114a-f144-411f-831e-46743bfeac8c req-4dad31b8-64cf-4792-abdc-ab55040453cd tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:44.652707 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8dbf114a-f144-411f-831e-46743bfeac8c req-4dad31b8-64cf-4792-abdc-ab55040453cd tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0488942 Sep 01 17:06:44.690326 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8dbf114a-f144-411f-831e-46743bfeac8c req-654c5d2c-85ae-412d-b5df-9d39a8fc727e tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0311427 Sep 01 17:06:45.404179 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device bb2db631-7e1f-45bc-b23c-b3e3181a12ab up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:06:45.453837 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port bb2db631-7e1f-45bc-b23c-b3e3181a12ab completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:06:45.457352 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port bb2db631-7e1f-45bc-b23c-b3e3181a12ab triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:06:45.457758 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:45.540388 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:45.552864 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ede9f1b-b7df-4c18-a7ec-85ae106863be req-2919ab9f-4af2-4081-a824-4a5d5bff640e tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:45.554384 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5ede9f1b-b7df-4c18-a7ec-85ae106863be req-2919ab9f-4af2-4081-a824-4a5d5bff640e tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 945 time: 0.0522196 Sep 01 17:06:45.574021 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port bb2db631-7e1f-45bc-b23c-b3e3181a12ab, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=bb2db631-7e1f-45bc-b23c-b3e3181a12ab,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:45.578763 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:45.579715 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device aec9941f-617a-4d03-a98b-27c5fea3c635 no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:06:45.594698 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5ede9f1b-b7df-4c18-a7ec-85ae106863be req-c0be16a1-b8b0-4e37-b610-a9f546738bb5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0341887 Sep 01 17:06:45.655405 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=bb2db631-7e1f-45bc-b23c-b3e3181a12ab,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:45.693635 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:45.698795 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-653bb684-ca3a-4c1d-bd86-2ceb057751c4 req-5c60022c-38e8-47d7-9b88-7c2a1d250623 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:45.700342 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-653bb684-ca3a-4c1d-bd86-2ceb057751c4 req-5c60022c-38e8-47d7-9b88-7c2a1d250623 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 945 time: 0.0506988 Sep 01 17:06:45.731067 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port aec9941f-617a-4d03-a98b-27c5fea3c635, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=aec9941f-617a-4d03-a98b-27c5fea3c635,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:45.736952 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:45.740960 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-653bb684-ca3a-4c1d-bd86-2ceb057751c4 req-6f6d42f2-f22a-4310-b276-202dc353cd38 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0341094 Sep 01 17:06:45.761870 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e47e85e5-f5f1-45ff-aad0-1c58527b7712', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb2db631-7e1f-45bc-b23c-b3e3181a12ab'}, {'server_uuid': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'aec9941f-617a-4d03-a98b-27c5fea3c635'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:06:45.765059 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1259d726-d065-42b6-96fd-f791c398a038" -d '{"events": [{"server_uuid": "e47e85e5-f5f1-45ff-aad0-1c58527b7712", "name": "network-vif-plugged", "status": "completed", "tag": "bb2db631-7e1f-45bc-b23c-b3e3181a12ab"}, {"server_uuid": "ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1", "name": "network-vif-unplugged", "status": "completed", "tag": "aec9941f-617a-4d03-a98b-27c5fea3c635"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:06:45.800472 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=aec9941f-617a-4d03-a98b-27c5fea3c635,revision_number=6']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:45.832242 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-157b3452-e67e-459c-a9c3-e76709d8bf74 req-de738126-b38c-49aa-9e98-0fd1e966364a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:45.833714 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-157b3452-e67e-459c-a9c3-e76709d8bf74 req-de738126-b38c-49aa-9e98-0fd1e966364a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 943 time: 0.0632837 Sep 01 17:06:45.892801 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-157b3452-e67e-459c-a9c3-e76709d8bf74 req-c6050f4c-3ef7-4625-aa01-c82b7ee3db9d tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0421209 Sep 01 17:06:45.900798 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68b4b8c-4d04-4011-9ed2-b6e40545219e req-c29af1d3-2d1b-4bfd-b1e7-3929bbba93fb tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:45.902496 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d68b4b8c-4d04-4011-9ed2-b6e40545219e req-c29af1d3-2d1b-4bfd-b1e7-3929bbba93fb tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 945 time: 0.0907862 Sep 01 17:06:45.941956 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d68b4b8c-4d04-4011-9ed2-b6e40545219e req-07f86719-a51c-4096-b095-8d62b2d840e3 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0326958 Sep 01 17:06:45.948791 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 356 Content-Type: application/json Date: Wed, 01 Sep 2021 17:06:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5263d414-d228-4282-ae6b-9772b2c84274 x-openstack-request-id: req-5263d414-d228-4282-ae6b-9772b2c84274 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:06:45.949085 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e47e85e5-f5f1-45ff-aad0-1c58527b7712", "name": "network-vif-plugged", "status": "completed", "tag": "bb2db631-7e1f-45bc-b23c-b3e3181a12ab", "code": 200}, {"server_uuid": "ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1", "name": "network-vif-unplugged", "status": "completed", "tag": "aec9941f-617a-4d03-a98b-27c5fea3c635", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:06:45.949337 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-5263d414-d228-4282-ae6b-9772b2c84274 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:06:45.949772 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e47e85e5-f5f1-45ff-aad0-1c58527b7712', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb2db631-7e1f-45bc-b23c-b3e3181a12ab', 'code': 200} Sep 01 17:06:45.950037 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'code': 200} Sep 01 17:06:45.964045 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60734) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:46.006092 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-732e4d75-dbef-423a-8e45-aadeebd3b10a tempest-TestVolumeBootPattern-345519433 tempest-TestVolumeBootPattern-345519433-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:46.007638 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-732e4d75-dbef-423a-8e45-aadeebd3b10a tempest-TestVolumeBootPattern-345519433 tempest-TestVolumeBootPattern-345519433-project-admin] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 1093 time: 0.0425141 Sep 01 17:06:46.010389 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60736) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:46.016057 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Request body: {'floatingip': {'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'port_id': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address': '172.20.0.7'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:06:46.038207 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for floatingip, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:46.143128 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b8572c9-ebfa-4763-8c75-24076c0ac250 req-34b643d4-74f9-4bbe-a9c5-04bcdd299ff8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:46.144606 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4b8572c9-ebfa-4763-8c75-24076c0ac250 req-34b643d4-74f9-4bbe-a9c5-04bcdd299ff8 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 1099 time: 0.0555348 Sep 01 17:06:46.195564 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-4b8572c9-ebfa-4763-8c75-24076c0ac250 req-ae379ed8-786f-4f4c-878e-aba7fe32f065 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427022 Sep 01 17:06:46.197348 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:46.303507 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Allocated IP 172.27.1.209 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/77363d3e-38e0-44a6-85e8-a51ff703a402) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:06:46.410091 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:46.448828 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:46.485771 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:06:46.490491 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:06:46.494005 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:06:46.521584 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'Port': ['ID=77363d3e-38e0-44a6-85e8-a51ff703a402,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:46.708024 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06779a08-6cc7-40fe-94ad-814abb92a176 req-cdfbbf8f-1cf7-4c68-85a0-e1c93831e9a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:46.709441 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-06779a08-6cc7-40fe-94ad-814abb92a176 req-cdfbbf8f-1cf7-4c68-85a0-e1c93831e9a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0478241 Sep 01 17:06:46.747339 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-06779a08-6cc7-40fe-94ad-814abb92a176 req-dcf105ff-676d-4604-810b-6669318f0c10 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0318315 Sep 01 17:06:47.009504 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1439f9-186d-40b5-b87a-110329a0f01e req-cf4a83b6-ee77-4004-89f7-a8c4f489809e tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:47.010940 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-da1439f9-186d-40b5-b87a-110329a0f01e req-cf4a83b6-ee77-4004-89f7-a8c4f489809e tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 943 time: 0.0497530 Sep 01 17:06:47.055039 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-da1439f9-186d-40b5-b87a-110329a0f01e req-27d4ca87-da26-4a8b-a6d3-13fc53ce844c tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0373359 Sep 01 17:06:47.114670 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:47.182332 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:47.335678 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:47.340003 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:47.411085 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event updated for resources: {'Port': ['ID=77363d3e-38e0-44a6-85e8-a51ff703a402,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:47.423684 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:47.525282 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.l3_db [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Floating IP 12a90566-a278-4229-9133-995dae47b145 associated. External IP: 172.27.1.209, port: f321a7eb-78b4-4ce9-b5ea-dc1dade4921b. Sep 01 17:06:47.726203 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:06:47.836003 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:06:47.846549 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc720fdb-d501-4912-8edf-5eda4807d23e None None] Sync routers for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:06:47.854352 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:47.856260 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc720fdb-d501-4912-8edf-5eda4807d23e None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:06:47.856885 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-bc720fdb-d501-4912-8edf-5eda4807d23e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:06:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:47.866855 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4034cbaf-fc3e-41c6-9ce7-7cdabf874aad req-c69e211a-709f-4b78-b43f-d4bb414de462 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:47.868368 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4034cbaf-fc3e-41c6-9ce7-7cdabf874aad req-c69e211a-709f-4b78-b43f-d4bb414de462 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0550802 Sep 01 17:06:47.883241 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-5ee999ac-66c5-4aaa-a477-315e12fa282e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8717227 Sep 01 17:06:47.883819 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'tag': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:06:47.886068 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7e70a72e-ff9c-45f5-afe1-d0cd2e6a949a" -d '{"events": [{"name": "network-changed", "server_uuid": "9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89", "tag": "f321a7eb-78b4-4ce9-b5ea-dc1dade4921b"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:06:47.924537 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:06:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f2a43c8d-132f-45fe-8564-35a2d643f3b2 x-openstack-request-id: req-f2a43c8d-132f-45fe-8564-35a2d643f3b2 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:06:47.924822 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89", "tag": "f321a7eb-78b4-4ce9-b5ea-dc1dade4921b", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:06:47.925070 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-f2a43c8d-132f-45fe-8564-35a2d643f3b2 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:06:47.925528 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'tag': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b', 'status': 'completed', 'code': 200} Sep 01 17:06:47.926147 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4034cbaf-fc3e-41c6-9ce7-7cdabf874aad req-6c3295f2-a3a2-42f3-87fc-d98a409e4872 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474067 Sep 01 17:06:47.998262 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e70a72e-ff9c-45f5-afe1-d0cd2e6a949a req-362b4acb-da94-4166-bccf-96b403fbeb96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:47.999995 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7e70a72e-ff9c-45f5-afe1-d0cd2e6a949a req-362b4acb-da94-4166-bccf-96b403fbeb96 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 1098 time: 0.0505872 Sep 01 17:06:48.050025 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0010d844-5fb5-47a8-9896-f96de2dd913c req-6ea689a9-4132-4dd2-8ee4-7262a846a328 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:48.051579 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0010d844-5fb5-47a8-9896-f96de2dd913c req-6ea689a9-4132-4dd2-8ee4-7262a846a328 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0579977 Sep 01 17:06:48.060182 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60750) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:06:48.065020 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-78765cd7-fbcf-460d-b829-440729735113 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Request body: {'floatingip': {'port_id': 'bb2db631-7e1f-45bc-b23c-b3e3181a12ab'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:06:48.080800 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-bc720fdb-d501-4912-8edf-5eda4807d23e None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:06:48.102998 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e70a72e-ff9c-45f5-afe1-d0cd2e6a949a req-a9c45b79-6ec0-40c8-a462-749775eef8b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:48.104503 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7e70a72e-ff9c-45f5-afe1-d0cd2e6a949a req-a9c45b79-6ec0-40c8-a462-749775eef8b9 service neutron] 10.222.0.69 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 912 time: 0.0952699 Sep 01 17:06:48.118495 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-78765cd7-fbcf-460d-b829-440729735113 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for floatingip, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:48.187640 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7e70a72e-ff9c-45f5-afe1-d0cd2e6a949a req-232bb60f-7f01-4275-8474-ec3183a43987 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b HTTP/1.1" status: 200 len: 999 time: 0.0736749 Sep 01 17:06:48.239539 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e70a72e-ff9c-45f5-afe1-d0cd2e6a949a req-d73aac41-22a7-4bb6-bb58-a06c3e3c3ebc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:48.241043 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7e70a72e-ff9c-45f5-afe1-d0cd2e6a949a req-d73aac41-22a7-4bb6-bb58-a06c3e3c3ebc service neutron] 10.222.0.69 "GET /v2.0/subnets?id=ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 200 len: 850 time: 0.0462313 Sep 01 17:06:48.255195 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c631e2ab-5c9b-4341-8a23-c9ec50abc0e7 req-ae85c635-5c19-466c-9561-4808455dda29 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:48.257033 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c631e2ab-5c9b-4341-8a23-c9ec50abc0e7 req-ae85c635-5c19-466c-9561-4808455dda29 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 943 time: 0.1062214 Sep 01 17:06:48.291845 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e70a72e-ff9c-45f5-afe1-d0cd2e6a949a req-469dc7b0-bca3-4c94-a421-6bcc0a82e12f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:48.293360 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7e70a72e-ff9c-45f5-afe1-d0cd2e6a949a req-469dc7b0-bca3-4c94-a421-6bcc0a82e12f service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=35c995f2-96ec-4a35-9f59-05221a09df3f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0450487 Sep 01 17:06:48.319232 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-bc720fdb-d501-4912-8edf-5eda4807d23e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '12a90566-a278-4229-9133-995dae47b145', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.209', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 654, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:70:2d:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:06:46Z', 'updated_at': '2021-09-01T17:06:46Z', 'revision_number': 0, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}, {'id': '9a981a6e-2c7d-4c4d-b4cc-f601ed27b585', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.141', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:43:d9:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:04:39Z', 'updated_at': '2021-09-01T17:04:41Z', 'revision_number': 1, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:48.346169 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-c631e2ab-5c9b-4341-8a23-c9ec50abc0e7 req-f9edd8bb-507b-4cb1-992c-197b1202e5fc tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0752456 Sep 01 17:06:48.351303 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc720fdb-d501-4912-8edf-5eda4807d23e None None] Checking router: 8724afe3-ad3a-4d4f-94c4-4642b6e0afab for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:06:48.365114 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc720fdb-d501-4912-8edf-5eda4807d23e None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:06:48.365884 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-bc720fdb-d501-4912-8edf-5eda4807d23e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:06:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:48.408649 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7e70a72e-ff9c-45f5-afe1-d0cd2e6a949a req-37a67362-251e-4736-bf28-e402e7671186 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1081042 Sep 01 17:06:48.477320 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-bc720fdb-d501-4912-8edf-5eda4807d23e None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:06:48.505763 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7e70a72e-ff9c-45f5-afe1-d0cd2e6a949a req-2497010c-531e-40f6-9c0e-f9e521105299 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0895033 Sep 01 17:06:48.637347 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-78765cd7-fbcf-460d-b829-440729735113 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for floatingip, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:48.641336 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-78765cd7-fbcf-460d-b829-440729735113 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:48.710505 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-bc720fdb-d501-4912-8edf-5eda4807d23e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '12a90566-a278-4229-9133-995dae47b145', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.209', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 654, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:70:2d:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:06:46Z', 'updated_at': '2021-09-01T17:06:46Z', 'revision_number': 0, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}, {'id': '9a981a6e-2c7d-4c4d-b4cc-f601ed27b585', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.141', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:43:d9:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:04:39Z', 'updated_at': '2021-09-01T17:04:41Z', 'revision_number': 1, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:48.737674 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc720fdb-d501-4912-8edf-5eda4807d23e None None] The sync data for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi is: [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '12a90566-a278-4229-9133-995dae47b145', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.209', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 654, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:70:2d:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:06:46Z', 'updated_at': '2021-09-01T17:06:46Z', 'revision_number': 0, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}, {'id': '9a981a6e-2c7d-4c4d-b4cc-f601ed27b585', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.141', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:43:d9:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:04:39Z', 'updated_at': '2021-09-01T17:04:41Z', 'revision_number': 1, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:06:48.740586 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.l3_db [None req-78765cd7-fbcf-460d-b829-440729735113 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Floating IP 7138ab7c-9607-42bc-87c9-96434f678761 associated. External IP: 172.27.1.146, port: bb2db631-7e1f-45bc-b23c-b3e3181a12ab. Sep 01 17:06:48.944974 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc3c7414-f752-425e-86e6-019882127391 None None] New status for floating IP 12a90566-a278-4229-9133-995dae47b145: ACTIVE {{(pid=93837) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:06:48.963694 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-78765cd7-fbcf-460d-b829-440729735113 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Router 983dc48a-7f67-4eed-9560-9f50c5b92a36 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:06:49.075786 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-78765cd7-fbcf-460d-b829-440729735113 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:06:49.081626 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-78765cd7-fbcf-460d-b829-440729735113 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:49.086364 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ea5b756-7fb4-4e0e-99ef-7e9dc08e9642 None None] Sync routers for ids ['983dc48a-7f67-4eed-9560-9f50c5b92a36'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:06:49.097126 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ea5b756-7fb4-4e0e-99ef-7e9dc08e9642 None None] Routers {'983dc48a-7f67-4eed-9560-9f50c5b92a36'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:06:49.097804 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-6ea5b756-7fb4-4e0e-99ef-7e9dc08e9642 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:06:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['983dc48a-7f67-4eed-9560-9f50c5b92a36'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:49.117628 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-78765cd7-fbcf-460d-b829-440729735113 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "PUT /v2.0/floatingips/7138ab7c-9607-42bc-87c9-96434f678761 HTTP/1.1" status: 200 len: 992 time: 1.0562165 Sep 01 17:06:49.118388 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e47e85e5-f5f1-45ff-aad0-1c58527b7712', 'tag': 'bb2db631-7e1f-45bc-b23c-b3e3181a12ab'}] {{(pid=93836) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:06:49.120859 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}60a7e58791dd3a103db7a0d35103b09d0a4cb2c205e1177c181e158a6fe3866f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11e08f58-1fda-45e9-ba40-fea9e795d8ea" -d '{"events": [{"name": "network-changed", "server_uuid": "e47e85e5-f5f1-45ff-aad0-1c58527b7712", "tag": "bb2db631-7e1f-45bc-b23c-b3e3181a12ab"}]}' {{(pid=93836) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:06:49.168575 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:06:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-26adccb4-2360-4f8e-95bd-3d040af704aa x-openstack-request-id: req-26adccb4-2360-4f8e-95bd-3d040af704aa {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:06:49.169079 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e47e85e5-f5f1-45ff-aad0-1c58527b7712", "tag": "bb2db631-7e1f-45bc-b23c-b3e3181a12ab", "status": "completed", "code": 200}]} {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:06:49.169376 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-26adccb4-2360-4f8e-95bd-3d040af704aa {{(pid=93836) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:06:49.169821 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e47e85e5-f5f1-45ff-aad0-1c58527b7712', 'tag': 'bb2db631-7e1f-45bc-b23c-b3e3181a12ab', 'status': 'completed', 'code': 200} Sep 01 17:06:49.215078 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-6ea5b756-7fb4-4e0e-99ef-7e9dc08e9642 None None] Set router 983dc48a-7f67-4eed-9560-9f50c5b92a36 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:06:49.230642 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e08f58-1fda-45e9-ba40-fea9e795d8ea req-9f37358b-2900-422d-965d-f5ffeb8e54e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:49.232170 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-11e08f58-1fda-45e9-ba40-fea9e795d8ea req-9f37358b-2900-422d-965d-f5ffeb8e54e7 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c&device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 1099 time: 0.0410848 Sep 01 17:06:49.327844 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e08f58-1fda-45e9-ba40-fea9e795d8ea req-d8083229-df9f-403a-9969-f8c401be65c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:49.329229 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-11e08f58-1fda-45e9-ba40-fea9e795d8ea req-d8083229-df9f-403a-9969-f8c401be65c9 service neutron] 10.222.0.69 "GET /v2.0/networks?id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25 HTTP/1.1" status: 200 len: 912 time: 0.0895128 Sep 01 17:06:49.407194 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-11e08f58-1fda-45e9-ba40-fea9e795d8ea req-aea85a0a-b51b-4730-a4d2-e5ccd8672606 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=bb2db631-7e1f-45bc-b23c-b3e3181a12ab HTTP/1.1" status: 200 len: 1000 time: 0.0703828 Sep 01 17:06:49.450188 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-6ea5b756-7fb4-4e0e-99ef-7e9dc08e9642 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '7138ab7c-9607-42bc-87c9-96434f678761', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'floating_ip_address': '172.27.1.146', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'port_id': 'bb2db631-7e1f-45bc-b23c-b3e3181a12ab', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 651, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'mac_address': 'fa:16:3e:75:21:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e47e85e5-f5f1-45ff-aad0-1c58527b7712', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:06:36Z', 'updated_at': '2021-09-01T17:06:48Z', 'revision_number': 1, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:38Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:49.467574 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4316fbb3-9a59-46d5-aed8-8eab5b81b8fb req-07ea3286-63be-4caf-81af-b6318d0647c6 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:49.468412 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e08f58-1fda-45e9-ba40-fea9e795d8ea req-60ef319b-afb2-4c7a-8436-c26be3e826aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:49.469290 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4316fbb3-9a59-46d5-aed8-8eab5b81b8fb req-07ea3286-63be-4caf-81af-b6318d0647c6 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 943 time: 0.0511684 Sep 01 17:06:49.470030 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-11e08f58-1fda-45e9-ba40-fea9e795d8ea req-60ef319b-afb2-4c7a-8436-c26be3e826aa service neutron] 10.222.0.69 "GET /v2.0/subnets?id=638b3e89-f5ce-4389-adde-079fe5b332cd HTTP/1.1" status: 200 len: 850 time: 0.0556190 Sep 01 17:06:49.477515 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ea5b756-7fb4-4e0e-99ef-7e9dc08e9642 None None] Checking router: 983dc48a-7f67-4eed-9560-9f50c5b92a36 for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:06:49.488623 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ea5b756-7fb4-4e0e-99ef-7e9dc08e9642 None None] Routers {'983dc48a-7f67-4eed-9560-9f50c5b92a36'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:06:49.489259 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-6ea5b756-7fb4-4e0e-99ef-7e9dc08e9642 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:06:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['983dc48a-7f67-4eed-9560-9f50c5b92a36'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:49.509010 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4316fbb3-9a59-46d5-aed8-8eab5b81b8fb req-63365b74-fbd5-429f-8346-f613fbc0ed97 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0333519 Sep 01 17:06:49.517653 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e08f58-1fda-45e9-ba40-fea9e795d8ea req-bdc43722-1c24-43f7-b8cc-24e775748c35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:49.519184 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-11e08f58-1fda-45e9-ba40-fea9e795d8ea req-bdc43722-1c24-43f7-b8cc-24e775748c35 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0417876 Sep 01 17:06:49.596476 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-6ea5b756-7fb4-4e0e-99ef-7e9dc08e9642 None None] Set router 983dc48a-7f67-4eed-9560-9f50c5b92a36 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:06:49.608600 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-11e08f58-1fda-45e9-ba40-fea9e795d8ea req-48aab170-a030-4a89-9507-a748af54f67b service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816975 Sep 01 17:06:49.704634 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-11e08f58-1fda-45e9-ba40-fea9e795d8ea req-e35c1bda-a2f2-4026-b59c-4d9713c1ec03 service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886049 Sep 01 17:06:49.825065 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-6ea5b756-7fb4-4e0e-99ef-7e9dc08e9642 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '7138ab7c-9607-42bc-87c9-96434f678761', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'floating_ip_address': '172.27.1.146', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'port_id': 'bb2db631-7e1f-45bc-b23c-b3e3181a12ab', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 651, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'mac_address': 'fa:16:3e:75:21:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e47e85e5-f5f1-45ff-aad0-1c58527b7712', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:06:36Z', 'updated_at': '2021-09-01T17:06:48Z', 'revision_number': 1, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:38Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:06:49.851461 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ea5b756-7fb4-4e0e-99ef-7e9dc08e9642 None None] The sync data for ids ['983dc48a-7f67-4eed-9560-9f50c5b92a36'] in dv-cinder-799668-16-iscsi is: [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '7138ab7c-9607-42bc-87c9-96434f678761', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'floating_ip_address': '172.27.1.146', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'port_id': 'bb2db631-7e1f-45bc-b23c-b3e3181a12ab', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 651, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'mac_address': 'fa:16:3e:75:21:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e47e85e5-f5f1-45ff-aad0-1c58527b7712', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:06:36Z', 'updated_at': '2021-09-01T17:06:48Z', 'revision_number': 1, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:38Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:06:50.035055 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56c3c1a3-2f3d-4863-80bd-e9a554279408 None None] New status for floating IP 7138ab7c-9607-42bc-87c9-96434f678761: ACTIVE {{(pid=93837) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:06:50.628534 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bd584e6-f913-469a-880d-22efa8b83cdc req-9640a9ee-df53-47d7-9658-7215a3d9f3e5 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:50.630078 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3bd584e6-f913-469a-880d-22efa8b83cdc req-9640a9ee-df53-47d7-9658-7215a3d9f3e5 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 943 time: 0.0533600 Sep 01 17:06:50.676751 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3bd584e6-f913-469a-880d-22efa8b83cdc req-1629c5da-499a-4472-9f88-87fcfdcb6af9 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0404234 Sep 01 17:06:50.712878 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17b6a10f-8d1b-46a8-9a50-63740a13bc97 req-de93ea68-8881-43b1-b37a-774ad8331368 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:50.714445 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-17b6a10f-8d1b-46a8-9a50-63740a13bc97 req-de93ea68-8881-43b1-b37a-774ad8331368 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 1096 time: 0.0407970 Sep 01 17:06:50.748852 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-17b6a10f-8d1b-46a8-9a50-63740a13bc97 req-cd57ebb1-caef-46e7-88f5-1be5e6500003 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0274692 Sep 01 17:06:51.243847 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-aedb952b-d764-4dc2-ba49-48b49b9f2823 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:51.796432 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e75d9718-2db3-44a0-8753-a5691e050e6b req-eeaf1417-35fd-4f56-a0ee-43f9d8be0868 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:51.798340 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e75d9718-2db3-44a0-8753-a5691e050e6b req-eeaf1417-35fd-4f56-a0ee-43f9d8be0868 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 943 time: 0.0562856 Sep 01 17:06:51.841674 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e75d9718-2db3-44a0-8753-a5691e050e6b req-d4f22746-58bb-444f-a25c-1d89490ae18c tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0363886 Sep 01 17:06:52.957280 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e522b7f8-d39f-4178-a2e0-c97342e04265 req-df7a7738-7367-47d1-b19d-4f56879f6c4a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:06:52.958761 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e522b7f8-d39f-4178-a2e0-c97342e04265 req-df7a7738-7367-47d1-b19d-4f56879f6c4a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 943 time: 0.0486615 Sep 01 17:06:52.995554 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e522b7f8-d39f-4178-a2e0-c97342e04265 req-171e05a7-dbef-43d0-87ad-bb58726f3c7a tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0307837 Sep 01 17:06:53.435011 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device aec9941f-617a-4d03-a98b-27c5fea3c635 details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:06:53.532673 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port aec9941f-617a-4d03-a98b-27c5fea3c635, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=aec9941f-617a-4d03-a98b-27c5fea3c635,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:53.543475 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'port_id': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'mac_address': 'fa:16:3e:0c:57:0e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 545, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '53347cb0-0e42-4047-9ec0-95b809608613', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:06:53.580159 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:53.592305 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id aec9941f-617a-4d03-a98b-27c5fea3c635 {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:06:53.611543 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port aec9941f-617a-4d03-a98b-27c5fea3c635, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=aec9941f-617a-4d03-a98b-27c5fea3c635,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:53.615179 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:53.803179 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=aec9941f-617a-4d03-a98b-27c5fea3c635,revision_number=7']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:53.805687 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:53.813856 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-ed4590fb-1c88-4924-973f-c6146bbef85a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:53.927541 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['aec9941f-617a-4d03-a98b-27c5fea3c635'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:06:54.926521 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:55.450367 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device aec9941f-617a-4d03-a98b-27c5fea3c635 up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:06:55.499889 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port aec9941f-617a-4d03-a98b-27c5fea3c635 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:06:55.500252 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:55.578254 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:55.601392 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aec9941f-617a-4d03-a98b-27c5fea3c635'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:06:55.603707 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b429a5e2-b20a-400f-a785-7b9bcbceb5cc" -d '{"events": [{"server_uuid": "ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1", "name": "network-vif-plugged", "status": "completed", "tag": "aec9941f-617a-4d03-a98b-27c5fea3c635"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:06:55.617320 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port aec9941f-617a-4d03-a98b-27c5fea3c635, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=aec9941f-617a-4d03-a98b-27c5fea3c635,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:06:55.621316 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:55.645852 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:06:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3dd17e20-643b-43ec-8739-035b61803e72 x-openstack-request-id: req-3dd17e20-643b-43ec-8739-035b61803e72 {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:06:55.646144 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1", "name": "network-vif-plugged", "status": "completed", "tag": "aec9941f-617a-4d03-a98b-27c5fea3c635", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:06:55.646397 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-3dd17e20-643b-43ec-8739-035b61803e72 {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:06:55.646787 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'code': 200} Sep 01 17:06:55.673955 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=aec9941f-617a-4d03-a98b-27c5fea3c635,revision_number=8']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:06:56.567948 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:06:56.621566 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:07:06.586006 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:07:21.244103 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-cca5fb89-2a5b-43c7-b26a-e0921b4141dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:07:23.773521 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:07:23.793275 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-d4b81770-0b7b-4952-8d9d-4d31e23325dc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:07:24.929872 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:07:26.568127 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:07:26.632158 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:07:33.481447 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f9cc8b4-d225-4975-80ee-41e780ad413c req-a1fe3965-dc21-4ae3-8206-6fb73fc3d1b8 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0393124 Sep 01 17:07:33.553164 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9cc8b4-d225-4975-80ee-41e780ad413c req-58d0ad94-ca7c-464b-acaf-d160dc818cb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:33.554683 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f9cc8b4-d225-4975-80ee-41e780ad413c req-58d0ad94-ca7c-464b-acaf-d160dc818cb0 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 1099 time: 0.0446107 Sep 01 17:07:33.666325 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9cc8b4-d225-4975-80ee-41e780ad413c req-af1ba448-73ec-466d-b08c-a712d703053f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:33.667807 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f9cc8b4-d225-4975-80ee-41e780ad413c req-af1ba448-73ec-466d-b08c-a712d703053f service neutron] 10.222.0.69 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 912 time: 0.0885177 Sep 01 17:07:33.741069 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f9cc8b4-d225-4975-80ee-41e780ad413c req-e312a357-4931-4cf2-bcc7-667dd82cbfab service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=71676e7c-69ca-4cba-8a82-4673e0fb57c6 HTTP/1.1" status: 200 len: 1002 time: 0.0633979 Sep 01 17:07:33.793179 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9cc8b4-d225-4975-80ee-41e780ad413c req-714e5e6c-a93a-42f2-a297-4dce9d2545b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:33.794683 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f9cc8b4-d225-4975-80ee-41e780ad413c req-714e5e6c-a93a-42f2-a297-4dce9d2545b7 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 200 len: 850 time: 0.0434341 Sep 01 17:07:33.842816 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9cc8b4-d225-4975-80ee-41e780ad413c req-809cbb0f-96f5-46aa-bf6d-302d4e59ba0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:33.844316 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f9cc8b4-d225-4975-80ee-41e780ad413c req-809cbb0f-96f5-46aa-bf6d-302d4e59ba0e service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=35c995f2-96ec-4a35-9f59-05221a09df3f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0417173 Sep 01 17:07:33.940024 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f9cc8b4-d225-4975-80ee-41e780ad413c req-7a1170ec-cc2b-4fc0-b308-020319ead97e service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861123 Sep 01 17:07:34.039020 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7f9cc8b4-d225-4975-80ee-41e780ad413c req-49bc71bd-4bef-4d8f-b67e-90d6966c3147 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841086 Sep 01 17:07:43.584380 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:07:44.396213 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-129c59a5-72f3-4987-9ed2-9bc3439ad5dc req-55da2928-0556-4a04-85a6-8ccca2bb63e5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:44.397770 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-129c59a5-72f3-4987-9ed2-9bc3439ad5dc req-55da2928-0556-4a04-85a6-8ccca2bb63e5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0494943 Sep 01 17:07:44.440124 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-129c59a5-72f3-4987-9ed2-9bc3439ad5dc req-903d1688-ffdd-46db-9c33-bdeae1f9beba tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0360870 Sep 01 17:07:45.561745 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79b19c8a-e54a-4859-afea-7898559c3dd5 req-7866e570-1c87-46c5-80ca-7eb3f8107e15 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:45.563229 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-79b19c8a-e54a-4859-afea-7898559c3dd5 req-7866e570-1c87-46c5-80ca-7eb3f8107e15 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0534308 Sep 01 17:07:45.601256 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-79b19c8a-e54a-4859-afea-7898559c3dd5 req-7b3da04c-fbe8-4636-a9b2-9402f6ada6c4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0319228 Sep 01 17:07:46.717395 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ae374e9-b10f-49c7-96f0-fe56f7cea996 req-f16851ff-5771-4766-9f44-cfe7ac9bc1e1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:46.718897 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3ae374e9-b10f-49c7-96f0-fe56f7cea996 req-f16851ff-5771-4766-9f44-cfe7ac9bc1e1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0489423 Sep 01 17:07:46.756069 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3ae374e9-b10f-49c7-96f0-fe56f7cea996 req-efa90fbb-67db-478a-b0ee-2b45eaa594e2 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0309258 Sep 01 17:07:47.870243 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d772ad27-ae30-4a85-82fb-8d4ad9717e24 req-c1a2c825-f73a-4055-9efe-1aa96694bc55 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:47.871710 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d772ad27-ae30-4a85-82fb-8d4ad9717e24 req-c1a2c825-f73a-4055-9efe-1aa96694bc55 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0481005 Sep 01 17:07:47.908255 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d772ad27-ae30-4a85-82fb-8d4ad9717e24 req-ea02265e-5848-435d-a1be-a419ba2f6fa9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0307951 Sep 01 17:07:49.025839 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3026b54f-62d5-465d-b5ee-6535d454b964 req-1b755f9d-ad50-41ed-922b-22edc28e766c tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:49.027544 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3026b54f-62d5-465d-b5ee-6535d454b964 req-1b755f9d-ad50-41ed-922b-22edc28e766c tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0521803 Sep 01 17:07:49.064732 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3026b54f-62d5-465d-b5ee-6535d454b964 req-89b69b24-8131-4980-82d9-041dec682897 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0313051 Sep 01 17:07:50.177665 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b70303f1-0b1a-490a-9c5e-93d44032cb31 req-0d686471-e233-4230-8f89-c3b545d9dac1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:50.179120 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b70303f1-0b1a-490a-9c5e-93d44032cb31 req-0d686471-e233-4230-8f89-c3b545d9dac1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0482657 Sep 01 17:07:50.215866 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b70303f1-0b1a-490a-9c5e-93d44032cb31 req-dbbd379c-3348-40bb-b82d-2cfa87a42768 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0309393 Sep 01 17:07:51.244983 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-088eb7ab-ecb3-4539-8539-41fd83c04de4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:07:51.333300 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a20c1d48-8392-4dd0-9161-2f08e780260c req-00417daf-9976-4e8c-b269-0a6705c9f3f0 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:51.334739 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a20c1d48-8392-4dd0-9161-2f08e780260c req-00417daf-9976-4e8c-b269-0a6705c9f3f0 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0509267 Sep 01 17:07:51.372900 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a20c1d48-8392-4dd0-9161-2f08e780260c req-6f20ccbe-cff9-49dd-b724-8e0e734b7f19 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0324054 Sep 01 17:07:52.490970 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9de8fe7d-4a0b-481e-9adb-dc23b710326c req-22d30d9c-0063-42ad-ae7d-a5f0312f0a58 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:52.492471 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9de8fe7d-4a0b-481e-9adb-dc23b710326c req-22d30d9c-0063-42ad-ae7d-a5f0312f0a58 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0514393 Sep 01 17:07:52.529887 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-9de8fe7d-4a0b-481e-9adb-dc23b710326c req-de12a325-a7f6-4df7-b8f9-793dafa113c0 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0308719 Sep 01 17:07:53.642892 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0892b1-0223-49c5-9dc6-8f86023dc5e3 req-cd64af65-be10-40d5-b3cd-2c6b10c34d31 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:53.644382 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1e0892b1-0223-49c5-9dc6-8f86023dc5e3 req-cd64af65-be10-40d5-b3cd-2c6b10c34d31 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0482190 Sep 01 17:07:53.681560 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-1e0892b1-0223-49c5-9dc6-8f86023dc5e3 req-94886eb7-85a1-43fa-ad63-b341e7bba95e tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0301182 Sep 01 17:07:53.776394 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:07:53.794343 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-9ab9f566-27ae-4a08-8a22-58bee14d83cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:07:54.794591 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b20046ca-9b63-4546-9e45-33065264fc25 req-c9fbc661-2596-4154-848d-b49b0c30b3be tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:54.796101 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b20046ca-9b63-4546-9e45-33065264fc25 req-c9fbc661-2596-4154-848d-b49b0c30b3be tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0483336 Sep 01 17:07:54.834504 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b20046ca-9b63-4546-9e45-33065264fc25 req-560aae43-4fcf-4892-80da-a78539d8b8a9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0323789 Sep 01 17:07:54.932015 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:07:55.952112 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6601b580-2e8c-4c19-9b8e-e856e1409047 req-56a6bdbe-9a9e-4ef1-be76-11a3459b3db5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:55.953610 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6601b580-2e8c-4c19-9b8e-e856e1409047 req-56a6bdbe-9a9e-4ef1-be76-11a3459b3db5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0522399 Sep 01 17:07:55.991027 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-6601b580-2e8c-4c19-9b8e-e856e1409047 req-114b4b13-d4f3-40a6-8d0b-337a03425a38 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0309732 Sep 01 17:07:56.572356 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:07:56.642176 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:07:57.107624 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93f63f56-a93f-4934-9498-f92396331edb req-6f442db5-233e-4e65-a5f8-9e27532326f1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:57.109110 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-93f63f56-a93f-4934-9498-f92396331edb req-6f442db5-233e-4e65-a5f8-9e27532326f1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0498319 Sep 01 17:07:57.147446 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-93f63f56-a93f-4934-9498-f92396331edb req-fb1bdcf1-29db-49b7-b1f9-f07d400c6db5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0320964 Sep 01 17:07:58.261014 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e750fa97-2059-472b-ab18-62d3a9ca1321 req-92e0a7da-5c4f-4f97-b9b6-c23c100e8362 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:58.262536 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e750fa97-2059-472b-ab18-62d3a9ca1321 req-92e0a7da-5c4f-4f97-b9b6-c23c100e8362 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0491652 Sep 01 17:07:58.301322 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e750fa97-2059-472b-ab18-62d3a9ca1321 req-be2ecefd-b574-4db0-971a-ec641c10b1f7 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0328646 Sep 01 17:07:59.423231 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a0c063-569d-40a8-b2a7-5a9bfd4f7943 req-b6dd2970-103e-48f3-be89-f8551737a43c tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:07:59.424712 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-45a0c063-569d-40a8-b2a7-5a9bfd4f7943 req-b6dd2970-103e-48f3-be89-f8551737a43c tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0545382 Sep 01 17:07:59.734867 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-45a0c063-569d-40a8-b2a7-5a9bfd4f7943 req-cd10a77a-3886-452d-8abe-2a0bce5759a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3018897 Sep 01 17:08:00.856370 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49478ed7-afcb-4afb-91ce-fbed9ec55579 req-a97140de-037e-418f-9f66-09a7e70c3c33 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:00.857763 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-49478ed7-afcb-4afb-91ce-fbed9ec55579 req-a97140de-037e-418f-9f66-09a7e70c3c33 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0477157 Sep 01 17:08:00.894531 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-49478ed7-afcb-4afb-91ce-fbed9ec55579 req-1ace5f01-0fbd-4565-9739-49b2f424cfc6 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0309973 Sep 01 17:08:01.089104 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd528dc-49f7-4613-be44-df53878a6581 req-43a7dbb3-a110-4828-b5d1-e739ea46b005 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:01.090778 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3fd528dc-49f7-4613-be44-df53878a6581 req-43a7dbb3-a110-4828-b5d1-e739ea46b005 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0482259 Sep 01 17:08:01.129705 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3fd528dc-49f7-4613-be44-df53878a6581 req-f83d8d99-9c01-4eec-9388-0e6b52c388d4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0326073 Sep 01 17:08:01.144445 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9be0e0e-164a-4ab3-8f07-10cec68ed1fe req-8e163a69-e3cf-403c-ae8c-973844c6e161 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:01.146053 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a9be0e0e-164a-4ab3-8f07-10cec68ed1fe req-8e163a69-e3cf-403c-ae8c-973844c6e161 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c&device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 1099 time: 0.0423431 Sep 01 17:08:01.242261 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9be0e0e-164a-4ab3-8f07-10cec68ed1fe req-bbbc902d-7761-4958-9bf9-dfd1f783d043 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:01.243707 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a9be0e0e-164a-4ab3-8f07-10cec68ed1fe req-bbbc902d-7761-4958-9bf9-dfd1f783d043 service neutron] 10.222.0.69 "GET /v2.0/networks?id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25 HTTP/1.1" status: 200 len: 912 time: 0.0898986 Sep 01 17:08:01.307343 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a9be0e0e-164a-4ab3-8f07-10cec68ed1fe req-310d1302-c144-4cd5-816d-13e00865e7dc service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=bb2db631-7e1f-45bc-b23c-b3e3181a12ab HTTP/1.1" status: 200 len: 1002 time: 0.0568275 Sep 01 17:08:01.359948 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9be0e0e-164a-4ab3-8f07-10cec68ed1fe req-d4d43aec-4447-4da1-85ad-a65a26cb35d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:01.361380 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a9be0e0e-164a-4ab3-8f07-10cec68ed1fe req-d4d43aec-4447-4da1-85ad-a65a26cb35d5 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=638b3e89-f5ce-4389-adde-079fe5b332cd HTTP/1.1" status: 200 len: 850 time: 0.0474851 Sep 01 17:08:01.406974 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9be0e0e-164a-4ab3-8f07-10cec68ed1fe req-5d27dc0e-2197-47d7-9add-6cf47cea2e2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:01.408373 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a9be0e0e-164a-4ab3-8f07-10cec68ed1fe req-5d27dc0e-2197-47d7-9add-6cf47cea2e2e service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0394838 Sep 01 17:08:01.496281 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a9be0e0e-164a-4ab3-8f07-10cec68ed1fe req-9a96b9b7-bd8b-480c-bd12-419c33640818 service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802450 Sep 01 17:08:01.590609 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a9be0e0e-164a-4ab3-8f07-10cec68ed1fe req-77f0299d-c504-4d8b-9889-f6b57d58e21d service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874207 Sep 01 17:08:02.251436 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0abf13ad-e247-4f9d-a4d4-e502b44018d5 req-eb7da7a4-a677-4f99-bebd-80fe3f2e848b tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:02.252957 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0abf13ad-e247-4f9d-a4d4-e502b44018d5 req-eb7da7a4-a677-4f99-bebd-80fe3f2e848b tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0529246 Sep 01 17:08:02.291937 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-0abf13ad-e247-4f9d-a4d4-e502b44018d5 req-9490c785-9476-49a4-b9db-5dd84e33d443 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0322924 Sep 01 17:08:03.407737 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b537dbc-6248-4511-87df-e76ee9acd882 req-06e3a44a-ede5-4b27-9d09-e1b15ed8243e tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:03.409219 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4b537dbc-6248-4511-87df-e76ee9acd882 req-06e3a44a-ede5-4b27-9d09-e1b15ed8243e tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0488811 Sep 01 17:08:03.447455 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4b537dbc-6248-4511-87df-e76ee9acd882 req-29e1adab-7931-48b5-87ea-eecf08d4345e tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0317085 Sep 01 17:08:14.595899 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60960) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:14.752402 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Deleting port 2d16abf6-6531-4f1d-84cf-8bd074ee11e0 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:14.752742 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:14.829014 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:14.829262 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:14.841055 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Calling delete_port for 2d16abf6-6531-4f1d-84cf-8bd074ee11e0 owned by network:floatingip {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:15.012051 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:15.038015 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Pushing event deleted for resources: {'Port': ['ID=2d16abf6-6531-4f1d-84cf-8bd074ee11e0,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:15.065139 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:15.065514 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:15.065861 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:15.066199 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:15.066534 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:15.066867 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:15.067197 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:15.067526 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:15.067854 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:15.068182 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:15.068506 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:15.068835 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:15.106436 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for floatingip, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:15.106697 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.l3_db [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Floating IP d4c9fab0-c3d4-4237-90ed-12694d6c7e03 disassociated (deleted). External IP: 172.27.1.169, port: aec9941f-617a-4d03-a98b-27c5fea3c635. Sep 01 17:08:15.317217 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:08:15.421911 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:08:15.426673 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:15.431744 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4d85ddd-71e6-4ec8-ab74-7d5927019d3e None None] Sync routers for ids ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:08:15.440773 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4d85ddd-71e6-4ec8-ab74-7d5927019d3e None None] Routers {'88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:08:15.441408 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-a4d85ddd-71e6-4ec8-ab74-7d5927019d3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:07:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:15.453925 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-f00da1a7-9236-48ad-9d8a-65db0f1b3504 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "DELETE /v2.0/floatingips/d4c9fab0-c3d4-4237-90ed-12694d6c7e03 HTTP/1.1" status: 204 len: 168 time: 0.8568404 Sep 01 17:08:15.454460 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'tag': 'aec9941f-617a-4d03-a98b-27c5fea3c635'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:08:15.456767 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5650750c-833b-4622-93f5-e04dac020f5b" -d '{"events": [{"name": "network-changed", "server_uuid": "ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1", "tag": "aec9941f-617a-4d03-a98b-27c5fea3c635"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:08:15.492856 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:08:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d7096c03-10ae-435f-810d-78f73dd37697 x-openstack-request-id: req-d7096c03-10ae-435f-810d-78f73dd37697 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:08:15.493148 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1", "tag": "aec9941f-617a-4d03-a98b-27c5fea3c635", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:08:15.493607 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-d7096c03-10ae-435f-810d-78f73dd37697 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:08:15.494075 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'tag': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'status': 'completed', 'code': 200} Sep 01 17:08:15.553723 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-a4d85ddd-71e6-4ec8-ab74-7d5927019d3e None None] Set router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:08:15.562309 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5650750c-833b-4622-93f5-e04dac020f5b req-f9846d99-2123-4f26-b6f3-42fb963823ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:15.564018 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5650750c-833b-4622-93f5-e04dac020f5b req-f9846d99-2123-4f26-b6f3-42fb963823ff service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=59475fb517464851810daf1967046d0c&device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 1098 time: 0.0474241 Sep 01 17:08:15.670419 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5650750c-833b-4622-93f5-e04dac020f5b req-58a841b5-a13c-4730-96b2-a74d90946d45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:15.672179 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5650750c-833b-4622-93f5-e04dac020f5b req-58a841b5-a13c-4730-96b2-a74d90946d45 service neutron] 10.222.0.69 "GET /v2.0/networks?id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f HTTP/1.1" status: 200 len: 910 time: 0.0963900 Sep 01 17:08:15.683490 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-636b42dc-eb8d-4602-a320-e4618765906e req-9966fab6-6c35-4b3a-a307-d66d197a34d4 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:15.685127 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-636b42dc-eb8d-4602-a320-e4618765906e req-9966fab6-6c35-4b3a-a307-d66d197a34d4 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0508237 Sep 01 17:08:15.717692 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5650750c-833b-4622-93f5-e04dac020f5b req-7d965753-ffe9-42b9-abde-588e298cbf42 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=aec9941f-617a-4d03-a98b-27c5fea3c635 HTTP/1.1" status: 200 len: 217 time: 0.0369759 Sep 01 17:08:15.726400 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-636b42dc-eb8d-4602-a320-e4618765906e req-4a5d3083-8853-4d9d-8163-e20d7d441e6d tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0340242 Sep 01 17:08:15.773593 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5650750c-833b-4622-93f5-e04dac020f5b req-eb8d6192-0293-4a4b-ad24-d54d843c849d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:15.775147 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5650750c-833b-4622-93f5-e04dac020f5b req-eb8d6192-0293-4a4b-ad24-d54d843c849d service neutron] 10.222.0.69 "GET /v2.0/subnets?id=53347cb0-0e42-4047-9ec0-95b809608613 HTTP/1.1" status: 200 len: 848 time: 0.0499594 Sep 01 17:08:15.780788 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-a4d85ddd-71e6-4ec8-ab74-7d5927019d3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75'}], 'enable_snat': True}, 'gw_port_id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:34Z', 'revision_number': 4, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port': {'id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:f8:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'b3f5695a-1b76-4688-983b-02a2efc00c3e', 'name': '', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'tenant_id': '59475fb517464851810daf1967046d0c', 'mac_address': 'fa:16:3e:1b:db:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 603, 'fixed_ips': [{'subnet_id': '53347cb0-0e42-4047-9ec0-95b809608613', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:33Z', 'updated_at': '2021-09-01T17:03:39Z', 'revision_number': 5, 'project_id': '59475fb517464851810daf1967046d0c', 'subnets': [{'id': '53347cb0-0e42-4047-9ec0-95b809608613', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:15.811321 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4d85ddd-71e6-4ec8-ab74-7d5927019d3e None None] Checking router: 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:08:15.819532 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4d85ddd-71e6-4ec8-ab74-7d5927019d3e None None] Routers {'88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:08:15.820141 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-a4d85ddd-71e6-4ec8-ab74-7d5927019d3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:07:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:15.827043 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5650750c-833b-4622-93f5-e04dac020f5b req-74ead26f-5a81-4a42-933c-0e818150c454 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:15.828546 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5650750c-833b-4622-93f5-e04dac020f5b req-74ead26f-5a81-4a42-933c-0e818150c454 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=e985feb4-0a78-4f0e-ad7c-52a73023bf6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0423875 Sep 01 17:08:15.920998 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5650750c-833b-4622-93f5-e04dac020f5b req-bd910829-a053-4873-a666-49ce9533d2e8 service neutron] 10.222.0.69 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0815563 Sep 01 17:08:15.925648 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-a4d85ddd-71e6-4ec8-ab74-7d5927019d3e None None] Set router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:08:16.016562 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5650750c-833b-4622-93f5-e04dac020f5b req-8a9f8663-57f9-4f0e-9a6b-308146863e26 service neutron] 10.222.0.69 "GET /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863974 Sep 01 17:08:16.124987 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-a4d85ddd-71e6-4ec8-ab74-7d5927019d3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75'}], 'enable_snat': True}, 'gw_port_id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:34Z', 'revision_number': 4, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port': {'id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:f8:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'b3f5695a-1b76-4688-983b-02a2efc00c3e', 'name': '', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'tenant_id': '59475fb517464851810daf1967046d0c', 'mac_address': 'fa:16:3e:1b:db:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 603, 'fixed_ips': [{'subnet_id': '53347cb0-0e42-4047-9ec0-95b809608613', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:33Z', 'updated_at': '2021-09-01T17:03:39Z', 'revision_number': 5, 'project_id': '59475fb517464851810daf1967046d0c', 'subnets': [{'id': '53347cb0-0e42-4047-9ec0-95b809608613', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:16.150648 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4d85ddd-71e6-4ec8-ab74-7d5927019d3e None None] The sync data for ids ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'] in dv-cinder-799668-16-iscsi is: [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75'}], 'enable_snat': True}, 'gw_port_id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:34Z', 'revision_number': 4, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port': {'id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:f8:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': 'b3f5695a-1b76-4688-983b-02a2efc00c3e', 'name': '', 'network_id': 'e985feb4-0a78-4f0e-ad7c-52a73023bf6f', 'tenant_id': '59475fb517464851810daf1967046d0c', 'mac_address': 'fa:16:3e:1b:db:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 603, 'fixed_ips': [{'subnet_id': '53347cb0-0e42-4047-9ec0-95b809608613', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:33Z', 'updated_at': '2021-09-01T17:03:39Z', 'revision_number': 5, 'project_id': '59475fb517464851810daf1967046d0c', 'subnets': [{'id': '53347cb0-0e42-4047-9ec0-95b809608613', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:08:16.348624 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cc3ffec-45ba-4f1d-9cd9-468f792d9575 None None] New status for floating IP d4c9fab0-c3d4-4237-90ed-12694d6c7e03: DOWN {{(pid=93837) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:08:16.849253 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-601c37bb-88fc-4a53-82d5-4be7394f584f req-8060a300-2f80-4ff0-ac5e-612d6e4b839f tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:16.850840 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-601c37bb-88fc-4a53-82d5-4be7394f584f req-8060a300-2f80-4ff0-ac5e-612d6e4b839f tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0513258 Sep 01 17:08:16.888028 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-601c37bb-88fc-4a53-82d5-4be7394f584f req-ab2ef4ac-f348-4f27-8913-3fc0aff44f42 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0306935 Sep 01 17:08:17.537190 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-388b3c2d-dfc1-46ef-8566-d8c57d1d3f8b req-2944572b-0161-4a12-a1b0-4d0f3becf5d0 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:17.538677 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-388b3c2d-dfc1-46ef-8566-d8c57d1d3f8b req-2944572b-0161-4a12-a1b0-4d0f3becf5d0 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.69 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0479515 Sep 01 17:08:17.631363 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-388b3c2d-dfc1-46ef-8566-d8c57d1d3f8b req-6c6f6b0c-c6ee-4a95-81f0-64d04bf54bd7 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Deleting port aec9941f-617a-4d03-a98b-27c5fea3c635 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:17.631716 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-388b3c2d-dfc1-46ef-8566-d8c57d1d3f8b req-6c6f6b0c-c6ee-4a95-81f0-64d04bf54bd7 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:17.717797 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-388b3c2d-dfc1-46ef-8566-d8c57d1d3f8b req-6c6f6b0c-c6ee-4a95-81f0-64d04bf54bd7 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] For port aec9941f-617a-4d03-a98b-27c5fea3c635, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=aec9941f-617a-4d03-a98b-27c5fea3c635,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:17.718294 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-388b3c2d-dfc1-46ef-8566-d8c57d1d3f8b req-6c6f6b0c-c6ee-4a95-81f0-64d04bf54bd7 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:17.731282 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-388b3c2d-dfc1-46ef-8566-d8c57d1d3f8b req-6c6f6b0c-c6ee-4a95-81f0-64d04bf54bd7 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Calling delete_port for aec9941f-617a-4d03-a98b-27c5fea3c635 owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:18.006366 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90718059-3718-4d6d-9e84-3426b294f4d0 req-7e7d95c1-c7b6-4c77-9480-4be1bb1088a8 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:18.008662 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-90718059-3718-4d6d-9e84-3426b294f4d0 req-7e7d95c1-c7b6-4c77-9480-4be1bb1088a8 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/ports?device_id=ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1 HTTP/1.1" status: 200 len: 945 time: 0.0507524 Sep 01 17:08:18.051625 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-90718059-3718-4d6d-9e84-3426b294f4d0 req-32ef0f77-e3c9-4e92-8f3e-d788e82571bf tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "GET /v2.0/security-groups?id=339064c2-239b-4c4c-877a-f7185ea53d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0369554 Sep 01 17:08:18.104550 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-388b3c2d-dfc1-46ef-8566-d8c57d1d3f8b req-6c6f6b0c-c6ee-4a95-81f0-64d04bf54bd7 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:18.138578 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c6f6b0c-c6ee-4a95-81f0-64d04bf54bd7 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Pushing event deleted for resources: {'Port': ['ID=aec9941f-617a-4d03-a98b-27c5fea3c635,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:18.177058 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-388b3c2d-dfc1-46ef-8566-d8c57d1d3f8b req-6c6f6b0c-c6ee-4a95-81f0-64d04bf54bd7 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] No DVR routers for this DVR port aec9941f-617a-4d03-a98b-27c5fea3c635 on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:08:18.180018 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-388b3c2d-dfc1-46ef-8566-d8c57d1d3f8b req-6c6f6b0c-c6ee-4a95-81f0-64d04bf54bd7 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:18.182175 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-388b3c2d-dfc1-46ef-8566-d8c57d1d3f8b req-6c6f6b0c-c6ee-4a95-81f0-64d04bf54bd7 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.69 "DELETE /v2.0/ports/aec9941f-617a-4d03-a98b-27c5fea3c635 HTTP/1.1" status: 204 len: 173 time: 0.6367874 Sep 01 17:08:18.182616 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'name': 'network-vif-deleted', 'tag': 'aec9941f-617a-4d03-a98b-27c5fea3c635'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:08:18.184809 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-804ab036-f5c3-4ef8-8c7c-87936918d21f" -d '{"events": [{"server_uuid": "ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1", "name": "network-vif-deleted", "tag": "aec9941f-617a-4d03-a98b-27c5fea3c635"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:08:18.221317 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:08:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-05e2b5c3-775b-46b4-a1e6-bace54dd66dc x-openstack-request-id: req-05e2b5c3-775b-46b4-a1e6-bace54dd66dc {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:08:18.221717 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1", "name": "network-vif-deleted", "tag": "aec9941f-617a-4d03-a98b-27c5fea3c635", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:08:18.221972 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-05e2b5c3-775b-46b4-a1e6-bace54dd66dc {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:08:18.222366 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ba9e2d49-f522-4f1a-b9fd-2fecabdab3b1', 'name': 'network-vif-deleted', 'tag': 'aec9941f-617a-4d03-a98b-27c5fea3c635', 'status': 'completed', 'code': 200} Sep 01 17:08:19.110187 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60978) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:19.173908 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-aa65b594-94a3-4476-9fb4-90706b220952 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:19.199534 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-aa65b594-94a3-4476-9fb4-90706b220952 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:19.262690 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-aa65b594-94a3-4476-9fb4-90706b220952 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:19.265246 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-aa65b594-94a3-4476-9fb4-90706b220952 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:19.266457 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-aa65b594-94a3-4476-9fb4-90706b220952 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] 10.222.0.67 "DELETE /v2.0/security-groups/339064c2-239b-4c4c-877a-f7185ea53d6b HTTP/1.1" status: 204 len: 168 time: 0.1552677 Sep 01 17:08:19.275916 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa65b594-94a3-4476-9fb4-90706b220952 tempest-TestShelveInstance-811407214 tempest-TestShelveInstance-811407214-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=339064c2-239b-4c4c-877a-f7185ea53d6b,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:19.309418 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60982) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:19.653543 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1832465'] for router_interface, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:19.890663 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Deleting port b3f5695a-1b76-4688-983b-02a2efc00c3e {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:19.891005 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:19.966850 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] For port b3f5695a-1b76-4688-983b-02a2efc00c3e, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=b3f5695a-1b76-4688-983b-02a2efc00c3e,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:19.967126 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:19.979151 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Calling delete_port for b3f5695a-1b76-4688-983b-02a2efc00c3e owned by network:router_interface {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:20.155914 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:20.183881 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Pushing event deleted for resources: {'Port': ['ID=b3f5695a-1b76-4688-983b-02a2efc00c3e,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:20.194931 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:20.195292 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:20.196194 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:20.196767 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:20.197227 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:20.197591 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:20.197930 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:20.198267 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:20.198600 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:20.198930 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:20.199257 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:20.199582 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:20.354634 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611377', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1832589'] for router_interface, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:20.572877 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:08:20.583133 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:08:20.678669 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:08:20.683825 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-f5b4f8f2-2545-4e69-8e3e-322fcaa22888 admin admin] 10.222.0.67 "PUT /v2.0/routers/88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.3737104 Sep 01 17:08:20.686523 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60984) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:20.687374 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25efb895-f8a4-480d-88f5-1ee4b0b3f8a3 None None] Sync routers for ids ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:08:20.697038 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25efb895-f8a4-480d-88f5-1ee4b0b3f8a3 None None] Routers {'88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:08:20.697672 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-25efb895-f8a4-480d-88f5-1ee4b0b3f8a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:07:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:20.791811 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] Notify callbacks [] for router, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:20.802216 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-25efb895-f8a4-480d-88f5-1ee4b0b3f8a3 None None] Set router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:08:20.895657 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:20.948326 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] Deleting port bc0c4eb8-de3a-41c7-8977-ea220855327a {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:20.948687 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:20.978672 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-25efb895-f8a4-480d-88f5-1ee4b0b3f8a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75'}], 'enable_snat': True}, 'gw_port_id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:08:20Z', 'revision_number': 5, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port': {'id': 'bc0c4eb8-de3a-41c7-8977-ea220855327a', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:f8:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 602, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:03:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:21.004697 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25efb895-f8a4-480d-88f5-1ee4b0b3f8a3 None None] Checking router: 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:08:21.013427 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25efb895-f8a4-480d-88f5-1ee4b0b3f8a3 None None] Routers {'88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:08:21.014041 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-25efb895-f8a4-480d-88f5-1ee4b0b3f8a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:07:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:21.029970 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] For port bc0c4eb8-de3a-41c7-8977-ea220855327a, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=bc0c4eb8-de3a-41c7-8977-ea220855327a,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:21.030336 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.042722 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] Calling delete_port for bc0c4eb8-de3a-41c7-8977-ea220855327a owned by network:router_gateway {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:21.098832 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-25efb895-f8a4-480d-88f5-1ee4b0b3f8a3 None None] Set router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc gateway port host: None {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:08:21.154422 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-25efb895-f8a4-480d-88f5-1ee4b0b3f8a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:08:20Z', 'revision_number': 6, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port_host': None}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:21.181606 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25efb895-f8a4-480d-88f5-1ee4b0b3f8a3 None None] The sync data for ids ['88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc'] in dv-cinder-799668-16-iscsi is: [{'id': '88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc', 'name': 'tempest-TestShelveInstance-2124785480-router', 'tenant_id': '59475fb517464851810daf1967046d0c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:30Z', 'updated_at': '2021-09-01T17:08:20Z', 'revision_number': 6, 'project_id': '59475fb517464851810daf1967046d0c', 'gw_port_host': None}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:08:21.209975 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.236471 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] Pushing event deleted for resources: {'Port': ['ID=bc0c4eb8-de3a-41c7-8977-ea220855327a,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:21.253214 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-ce909a32-834e-468b-8f70-c0604b81625d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.299650 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1827887'] for router_gateway, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.388497 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1821713', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4617'] for router, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.390617 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.436602 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1821722'] for router, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.437048 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc {{(pid=93835) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 01 17:08:21.441334 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] Notify callbacks [] for router, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.442509 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-5896c011-51b5-4888-8fb4-e23505330f14 admin admin] 10.222.0.67 "DELETE /v2.0/routers/88a95d20-f6f1-4a71-8b8c-deb4d2ca77cc HTTP/1.1" status: 204 len: 168 time: 0.7550018 Sep 01 17:08:21.444967 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60986) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:21.488772 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_v2 [None req-4e59a738-adce-46a7-84d4-678c8dcc49ab admin admin] Deleting subnet 53347cb0-0e42-4047-9ec0-95b809608613 {{(pid=93835) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 17:08:21.491686 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4e59a738-adce-46a7-84d4-678c8dcc49ab admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.527295 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4e59a738-adce-46a7-84d4-678c8dcc49ab admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8197692'] for subnet, precommit_delete_associations {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.616010 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4e59a738-adce-46a7-84d4-678c8dcc49ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.667092 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4e59a738-adce-46a7-84d4-678c8dcc49ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7342711', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5120114'] for subnet, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.691779 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e59a738-adce-46a7-84d4-678c8dcc49ab admin admin] Pushing event deleted for resources: {'Subnet': ['ID=53347cb0-0e42-4047-9ec0-95b809608613,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:21.695463 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-4e59a738-adce-46a7-84d4-678c8dcc49ab admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.697464 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-4e59a738-adce-46a7-84d4-678c8dcc49ab admin admin] 10.222.0.67 "DELETE /v2.0/subnets/53347cb0-0e42-4047-9ec0-95b809608613 HTTP/1.1" status: 204 len: 168 time: 0.2515008 Sep 01 17:08:21.700002 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 60988) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:21.702512 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cfa7d7bf-2c24-4b5b-ae96-8c382be76668 None None] Network e985feb4-0a78-4f0e-ad7c-52a73023bf6f requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:08:21.768246 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.826530 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Deleting port 194f0b8b-5439-4609-9cd0-d95d6fc8e621 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:21.826875 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.887930 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device aec9941f-617a-4d03-a98b-27c5fea3c635 no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:21.889703 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] For port 194f0b8b-5439-4609-9cd0-d95d6fc8e621, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=194f0b8b-5439-4609-9cd0-d95d6fc8e621,segment=NetworkSegment(7629b231-1a75-4951-b23d-eecb3ccb3fd6),segment_id=7629b231-1a75-4951-b23d-eecb3ccb3fd6)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:21.890082 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.904932 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Calling delete_port for 194f0b8b-5439-4609-9cd0-d95d6fc8e621 owned by network:dhcp {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:21.912577 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: aec9941f-617a-4d03-a98b-27c5fea3c635 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:21.912945 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device aec9941f-617a-4d03-a98b-27c5fea3c635 not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:21.949909 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] DHCP port deletion for e985feb4-0a78-4f0e-ad7c-52a73023bf6f request from dv-cinder-799668-16-iscsi {{(pid=93837) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 01 17:08:21.994251 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:21.998513 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Deleting port 194f0b8b-5439-4609-9cd0-d95d6fc8e621 {{(pid=93837) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:21.998991 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:22.027557 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Pushing event deleted for resources: {'Port': ['ID=194f0b8b-5439-4609-9cd0-d95d6fc8e621,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:22.035439 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] No DVR routers for this DVR port 194f0b8b-5439-4609-9cd0-d95d6fc8e621 on host dv-cinder-799668-16-iscsi {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:08:22.069362 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] For port 194f0b8b-5439-4609-9cd0-d95d6fc8e621, host dv-cinder-799668-16-iscsi, got binding levels [] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:22.069767 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:22.082774 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Calling delete_port for 194f0b8b-5439-4609-9cd0-d95d6fc8e621 owned by network:dhcp {{(pid=93837) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:22.085410 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.ipam_backend_mixin [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Port 194f0b8b-5439-4609-9cd0-d95d6fc8e621 was not found and therefore no delete operation was performed {{(pid=93837) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Sep 01 17:08:22.087478 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377'] for port, after_delete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:22.109195 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:22.116446 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Pushing event deleted for resources: {'Port': ['ID=194f0b8b-5439-4609-9cd0-d95d6fc8e621,revision_number=None']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:22.121478 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e985feb4-0a78-4f0e-ad7c-52a73023bf6f']}} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:22.123690 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] No DVR routers for this DVR port 194f0b8b-5439-4609-9cd0-d95d6fc8e621 on host dv-cinder-799668-16-iscsi {{(pid=93837) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:08:22.126175 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:22.126535 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:22.126946 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:22.127288 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:22.127636 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:22.127972 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:22.128305 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:22.128634 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:22.129473 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:22.129473 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:22.129707 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:22.129928 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b855641-ce7a-42a0-927b-350ded135374 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:08:22.132677 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7629b231-1a75-4951-b23d-eecb3ccb3fd6') {'for_net_delete': True} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:22.134083 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7629b231-1a75-4951-b23d-eecb3ccb3fd6') {} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:22.143534 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8197639'] for segment, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:22.159073 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:22.165983 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Releasing vlan 545 on physical network physnet1 to pool {{(pid=93835) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 17:08:22.166316 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7342797'] for segment, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: Traceback (most recent call last): Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: timer() Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: cb(*args, **kw) Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: return func(*args, **kwargs) Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: self._notify() Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: self.callback(batched_events) Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: event.method(event) Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: return f(self, *a, **k) Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._get(url).json() Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: return self.request(url, 'GET', **kwargs) Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 17:08:22.167988 dv-cinder-799668-16-iscsi neutron-server[93835]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 17:08:22.229721 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:22.235251 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:22.237130 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] 10.222.0.67 "DELETE /v2.0/networks/e985feb4-0a78-4f0e-ad7c-52a73023bf6f HTTP/1.1" status: 204 len: 168 time: 0.5362062 Sep 01 17:08:22.240294 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60990) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:22.248242 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24036af3-6045-44df-bba7-2d856c0c3b8f admin admin] Pushing event deleted for resources: {'Network': ['ID=e985feb4-0a78-4f0e-ad7c-52a73023bf6f,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:22.583980 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e776d03b-653a-44b1-aa46-c2f60c122619 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1832465'] for router_interface, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:22.624528 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device bc0c4eb8-de3a-41c7-8977-ea220855327a no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:22.644931 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: bc0c4eb8-de3a-41c7-8977-ea220855327a {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:22.645281 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device bc0c4eb8-de3a-41c7-8977-ea220855327a not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:22.645729 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 194f0b8b-5439-4609-9cd0-d95d6fc8e621 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:22.665581 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 194f0b8b-5439-4609-9cd0-d95d6fc8e621 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:22.665936 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 194f0b8b-5439-4609-9cd0-d95d6fc8e621 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:22.666357 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device b3f5695a-1b76-4688-983b-02a2efc00c3e no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:22.684629 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: b3f5695a-1b76-4688-983b-02a2efc00c3e {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:22.684980 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device b3f5695a-1b76-4688-983b-02a2efc00c3e not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:22.824928 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-e776d03b-653a-44b1-aa46-c2f60c122619 admin admin] Deleting port a1877e10-60db-47f0-adb3-2ad8f3753b36 {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:22.825158 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e776d03b-653a-44b1-aa46-c2f60c122619 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:22.900446 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [None req-e776d03b-653a-44b1-aa46-c2f60c122619 admin admin] For port a1877e10-60db-47f0-adb3-2ad8f3753b36, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=a1877e10-60db-47f0-adb3-2ad8f3753b36,segment=NetworkSegment(125e7130-5134-4c18-b009-f88603063dcb),segment_id=125e7130-5134-4c18-b009-f88603063dcb)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:22.900817 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e776d03b-653a-44b1-aa46-c2f60c122619 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:22.916728 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-e776d03b-653a-44b1-aa46-c2f60c122619 admin admin] Calling delete_port for a1877e10-60db-47f0-adb3-2ad8f3753b36 owned by network:router_interface {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:23.091467 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e776d03b-653a-44b1-aa46-c2f60c122619 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:23.116941 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e776d03b-653a-44b1-aa46-c2f60c122619 admin admin] Pushing event deleted for resources: {'Port': ['ID=a1877e10-60db-47f0-adb3-2ad8f3753b36,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:23.285071 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e776d03b-653a-44b1-aa46-c2f60c122619 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611377', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1832589'] for router_interface, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:23.732261 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e776d03b-653a-44b1-aa46-c2f60c122619 admin admin] Router 79abe9a2-b31c-4365-9aa2-847054f5a3ff has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:08:23.780403 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:23.795999 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-cd92b4c6-bc24-49e9-b334-6811e6cbdbb3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:23.840316 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e776d03b-653a-44b1-aa46-c2f60c122619 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:08:23.845212 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-e776d03b-653a-44b1-aa46-c2f60c122619 admin admin] 10.222.0.67 "PUT /v2.0/routers/79abe9a2-b31c-4365-9aa2-847054f5a3ff/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6038606 Sep 01 17:08:23.847663 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60992) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:23.853058 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b66d9f1-d05c-489a-a61a-c30e0ad094cd None None] Sync routers for ids ['79abe9a2-b31c-4365-9aa2-847054f5a3ff'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:08:23.864980 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b66d9f1-d05c-489a-a61a-c30e0ad094cd None None] Routers {'79abe9a2-b31c-4365-9aa2-847054f5a3ff'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:08:23.865633 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-1b66d9f1-d05c-489a-a61a-c30e0ad094cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:08:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['79abe9a2-b31c-4365-9aa2-847054f5a3ff'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:23.957312 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] Notify callbacks [] for router, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:23.970245 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-1b66d9f1-d05c-489a-a61a-c30e0ad094cd None None] Set router 79abe9a2-b31c-4365-9aa2-847054f5a3ff gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:08:24.060382 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.112243 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] Deleting port 124ce734-80f9-49e1-8136-5c2cba80df02 {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:24.112605 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.149876 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-1b66d9f1-d05c-489a-a61a-c30e0ad094cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'name': 'tempest-TestShelveInstance-531980329-router', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.48'}], 'enable_snat': True}, 'gw_port_id': '124ce734-80f9-49e1-8136-5c2cba80df02', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:36Z', 'updated_at': '2021-09-01T17:08:23Z', 'revision_number': 5, 'project_id': 'a7a2f1ded52e47fbabc7384bca188240', 'gw_port': {'id': '124ce734-80f9-49e1-8136-5c2cba80df02', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:b6:6b:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 614, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:03:37Z', 'updated_at': '2021-09-01T17:03:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:24.179163 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b66d9f1-d05c-489a-a61a-c30e0ad094cd None None] Checking router: 79abe9a2-b31c-4365-9aa2-847054f5a3ff for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:08:24.188265 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b66d9f1-d05c-489a-a61a-c30e0ad094cd None None] Routers {'79abe9a2-b31c-4365-9aa2-847054f5a3ff'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:08:24.188866 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-1b66d9f1-d05c-489a-a61a-c30e0ad094cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:08:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['79abe9a2-b31c-4365-9aa2-847054f5a3ff'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:24.192044 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] For port 124ce734-80f9-49e1-8136-5c2cba80df02, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=124ce734-80f9-49e1-8136-5c2cba80df02,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:24.192414 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.205239 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] Calling delete_port for 124ce734-80f9-49e1-8136-5c2cba80df02 owned by network:router_gateway {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:24.282586 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-1b66d9f1-d05c-489a-a61a-c30e0ad094cd None None] Set router 79abe9a2-b31c-4365-9aa2-847054f5a3ff gateway port host: None {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:08:24.332802 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-1b66d9f1-d05c-489a-a61a-c30e0ad094cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'name': 'tempest-TestShelveInstance-531980329-router', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:36Z', 'updated_at': '2021-09-01T17:08:24Z', 'revision_number': 6, 'project_id': 'a7a2f1ded52e47fbabc7384bca188240', 'gw_port_host': None}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:24.361973 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b66d9f1-d05c-489a-a61a-c30e0ad094cd None None] The sync data for ids ['79abe9a2-b31c-4365-9aa2-847054f5a3ff'] in dv-cinder-799668-16-iscsi is: [{'id': '79abe9a2-b31c-4365-9aa2-847054f5a3ff', 'name': 'tempest-TestShelveInstance-531980329-router', 'tenant_id': 'a7a2f1ded52e47fbabc7384bca188240', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:03:36Z', 'updated_at': '2021-09-01T17:08:24Z', 'revision_number': 6, 'project_id': 'a7a2f1ded52e47fbabc7384bca188240', 'gw_port_host': None}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:08:24.374057 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.408291 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] Pushing event deleted for resources: {'Port': ['ID=124ce734-80f9-49e1-8136-5c2cba80df02,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:24.464039 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1827887'] for router_gateway, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.551491 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1821713', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4617'] for router, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.553657 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.595596 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1821722'] for router, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.596110 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 79abe9a2-b31c-4365-9aa2-847054f5a3ff {{(pid=93836) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 01 17:08:24.600349 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] Notify callbacks [] for router, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.601474 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-f46e342d-9810-409d-aa4e-f8744aaec360 admin admin] 10.222.0.67 "DELETE /v2.0/routers/79abe9a2-b31c-4365-9aa2-847054f5a3ff HTTP/1.1" status: 204 len: 168 time: 0.7529366 Sep 01 17:08:24.604802 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60994) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:24.651006 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_v2 [None req-602efb23-3e88-49fa-a66e-07e1c12e0e1e admin admin] Deleting subnet 448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4 {{(pid=93836) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 17:08:24.654227 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-602efb23-3e88-49fa-a66e-07e1c12e0e1e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.687888 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-602efb23-3e88-49fa-a66e-07e1c12e0e1e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5815122'] for subnet, precommit_delete_associations {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.780290 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-602efb23-3e88-49fa-a66e-07e1c12e0e1e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.834151 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-602efb23-3e88-49fa-a66e-07e1c12e0e1e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6279800', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6181087'] for subnet, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.865371 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-602efb23-3e88-49fa-a66e-07e1c12e0e1e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:24.867383 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-602efb23-3e88-49fa-a66e-07e1c12e0e1e admin admin] Notify callbacks [] for subnet, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.869971 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-602efb23-3e88-49fa-a66e-07e1c12e0e1e admin admin] 10.222.0.67 "DELETE /v2.0/subnets/448acf94-fa06-4eb3-a8ca-3a7eac9dcdc4 HTTP/1.1" status: 204 len: 168 time: 0.2642021 Sep 01 17:08:24.871775 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 60996) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:24.872297 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9863ae90-1576-4012-a8a8-e4a18ce8ead3 None None] Network da82e365-d8f6-432c-8d68-9fd1f25319ca requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:08:24.937868 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.948016 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:24.990141 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Deleting port 19061490-6b80-4580-a739-1b04aea7545c {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:24.990504 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:25.057414 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] For port 19061490-6b80-4580-a739-1b04aea7545c, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=19061490-6b80-4580-a739-1b04aea7545c,segment=NetworkSegment(125e7130-5134-4c18-b009-f88603063dcb),segment_id=125e7130-5134-4c18-b009-f88603063dcb)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:25.057720 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:25.070122 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Calling delete_port for 19061490-6b80-4580-a739-1b04aea7545c owned by network:dhcp {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:25.146035 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device a1877e10-60db-47f0-adb3-2ad8f3753b36 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:25.149122 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0a8e01e-0494-4d03-aba3-4f5b5ed720b1 None None] DHCP port deletion for da82e365-d8f6-432c-8d68-9fd1f25319ca request from dv-cinder-799668-16-iscsi {{(pid=93837) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 01 17:08:25.150971 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:25.169182 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: a1877e10-60db-47f0-adb3-2ad8f3753b36 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:25.169551 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device a1877e10-60db-47f0-adb3-2ad8f3753b36 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:25.178005 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Pushing event deleted for resources: {'Port': ['ID=19061490-6b80-4580-a739-1b04aea7545c,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:25.182385 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] No DVR routers for this DVR port 19061490-6b80-4580-a739-1b04aea7545c on host dv-cinder-799668-16-iscsi {{(pid=93836) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:08:25.256021 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:25.266111 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['da82e365-d8f6-432c-8d68-9fd1f25319ca']}} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:25.277251 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '125e7130-5134-4c18-b009-f88603063dcb') {'for_net_delete': True} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:25.277579 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.services.segments.db [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '125e7130-5134-4c18-b009-f88603063dcb') {} {{(pid=93836) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:25.286417 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5815145'] for segment, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:25.301580 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:25.308024 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Releasing vlan 546 on physical network physnet1 to pool {{(pid=93836) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 17:08:25.308415 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6279874'] for segment, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: Traceback (most recent call last): Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: timer() Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: cb(*args, **kw) Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: return func(*args, **kwargs) Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: self._notify() Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: self.callback(batched_events) Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: event.method(event) Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: return f(self, *a, **k) Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: return self._get(url).json() Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: return self.request(url, 'GET', **kwargs) Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 17:08:25.310139 dv-cinder-799668-16-iscsi neutron-server[93836]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 17:08:25.370519 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:25.378956 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:25.383517 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] 10.222.0.67 "DELETE /v2.0/networks/da82e365-d8f6-432c-8d68-9fd1f25319ca HTTP/1.1" status: 204 len: 168 time: 0.5084555 Sep 01 17:08:25.393263 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4da661d-b999-45d8-905b-0a31bf405027 admin admin] Pushing event deleted for resources: {'Network': ['ID=da82e365-d8f6-432c-8d68-9fd1f25319ca,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:25.497969 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32768) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:25.537747 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-2e84227f-b6fe-4b0f-925d-bf1051e1b49d admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=59475fb517464851810daf1967046d0c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0385902 Sep 01 17:08:25.540834 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32770) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:25.588243 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a4c40246-c5a1-4c6d-8e22-390320e73df0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:25.608828 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a4c40246-c5a1-4c6d-8e22-390320e73df0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:25.661001 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a4c40246-c5a1-4c6d-8e22-390320e73df0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:25.665246 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-a4c40246-c5a1-4c6d-8e22-390320e73df0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:25.666435 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-a4c40246-c5a1-4c6d-8e22-390320e73df0 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/e6dab25c-1b35-4d97-b5fa-47f672cdf15b HTTP/1.1" status: 204 len: 168 time: 0.1246712 Sep 01 17:08:25.675774 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4c40246-c5a1-4c6d-8e22-390320e73df0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6dab25c-1b35-4d97-b5fa-47f672cdf15b,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:25.971029 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32776) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:26.016779 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-ac5c69d8-ff44-47cf-a5fd-ef7f5c5c2dfc admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=a7a2f1ded52e47fbabc7384bca188240&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0445454 Sep 01 17:08:26.019257 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32778) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:26.071283 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-94e33a8d-5712-4aeb-97a7-8686f0be7e24 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:26.095963 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-94e33a8d-5712-4aeb-97a7-8686f0be7e24 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:26.142773 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-94e33a8d-5712-4aeb-97a7-8686f0be7e24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:26.145285 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-94e33a8d-5712-4aeb-97a7-8686f0be7e24 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:26.146528 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-94e33a8d-5712-4aeb-97a7-8686f0be7e24 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/0775e657-1ebf-4905-94d7-1f1563246d80 HTTP/1.1" status: 204 len: 168 time: 0.1263762 Sep 01 17:08:26.154970 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94e33a8d-5712-4aeb-97a7-8686f0be7e24 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0775e657-1ebf-4905-94d7-1f1563246d80,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:26.574530 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:26.622487 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 19061490-6b80-4580-a739-1b04aea7545c no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:26.645904 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 19061490-6b80-4580-a739-1b04aea7545c {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:26.646252 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 19061490-6b80-4580-a739-1b04aea7545c not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:26.646667 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 124ce734-80f9-49e1-8136-5c2cba80df02 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:26.670514 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 124ce734-80f9-49e1-8136-5c2cba80df02 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:26.670866 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 124ce734-80f9-49e1-8136-5c2cba80df02 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:26.675626 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:31.943541 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32784) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:32.095423 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-1841099a-d006-4a78-a02c-32b89f93dc19 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Deleting port 77363d3e-38e0-44a6-85e8-a51ff703a402 {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:32.095764 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1841099a-d006-4a78-a02c-32b89f93dc19 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:32.174211 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1841099a-d006-4a78-a02c-32b89f93dc19 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:32.174540 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1841099a-d006-4a78-a02c-32b89f93dc19 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:32.185700 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-1841099a-d006-4a78-a02c-32b89f93dc19 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Calling delete_port for 77363d3e-38e0-44a6-85e8-a51ff703a402 owned by network:floatingip {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:32.322969 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1841099a-d006-4a78-a02c-32b89f93dc19 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:32.352074 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1841099a-d006-4a78-a02c-32b89f93dc19 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event deleted for resources: {'Port': ['ID=77363d3e-38e0-44a6-85e8-a51ff703a402,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:32.410376 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1841099a-d006-4a78-a02c-32b89f93dc19 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for floatingip, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:32.410697 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.l3_db [None req-1841099a-d006-4a78-a02c-32b89f93dc19 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Floating IP 12a90566-a278-4229-9133-995dae47b145 disassociated (deleted). External IP: 172.27.1.209, port: f321a7eb-78b4-4ce9-b5ea-dc1dade4921b. Sep 01 17:08:32.616260 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1841099a-d006-4a78-a02c-32b89f93dc19 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:08:32.721687 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1841099a-d006-4a78-a02c-32b89f93dc19 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:08:32.727106 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1841099a-d006-4a78-a02c-32b89f93dc19 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:32.733229 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cec2f6d1-f485-4444-9302-d208280471ae None None] Sync routers for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:08:32.743526 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cec2f6d1-f485-4444-9302-d208280471ae None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:08:32.744157 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-cec2f6d1-f485-4444-9302-d208280471ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:08:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:32.756077 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-1841099a-d006-4a78-a02c-32b89f93dc19 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "DELETE /v2.0/floatingips/12a90566-a278-4229-9133-995dae47b145 HTTP/1.1" status: 204 len: 168 time: 0.8088186 Sep 01 17:08:32.756077 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'tag': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b'}] {{(pid=93836) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:08:32.756515 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}60a7e58791dd3a103db7a0d35103b09d0a4cb2c205e1177c181e158a6fe3866f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-37ca2cd4-1613-4ed2-90f1-96c261be5436" -d '{"events": [{"name": "network-changed", "server_uuid": "9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89", "tag": "f321a7eb-78b4-4ce9-b5ea-dc1dade4921b"}]}' {{(pid=93836) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:08:32.800821 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:08:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4142cfb0-c891-4321-b229-3dca00179fbd x-openstack-request-id: req-4142cfb0-c891-4321-b229-3dca00179fbd {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:08:32.801119 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89", "tag": "f321a7eb-78b4-4ce9-b5ea-dc1dade4921b", "status": "completed", "code": 200}]} {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:08:32.801404 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-4142cfb0-c891-4321-b229-3dca00179fbd {{(pid=93836) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:08:32.801809 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'tag': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b', 'status': 'completed', 'code': 200} Sep 01 17:08:32.867976 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ca2cd4-1613-4ed2-90f1-96c261be5436 req-5c99d0cf-96e5-4b4a-aecd-998820e649bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:32.870051 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37ca2cd4-1613-4ed2-90f1-96c261be5436 req-5c99d0cf-96e5-4b4a-aecd-998820e649bf service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 1098 time: 0.0454748 Sep 01 17:08:32.964583 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-cec2f6d1-f485-4444-9302-d208280471ae None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:08:32.986009 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ca2cd4-1613-4ed2-90f1-96c261be5436 req-4139ea66-cf4d-49ae-959e-837d1e15c38e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:32.987503 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37ca2cd4-1613-4ed2-90f1-96c261be5436 req-4139ea66-cf4d-49ae-959e-837d1e15c38e service neutron] 10.222.0.69 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 912 time: 0.0982811 Sep 01 17:08:33.034700 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37ca2cd4-1613-4ed2-90f1-96c261be5436 req-1d24c488-84f1-41a7-9b87-45e608c8d38c service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b HTTP/1.1" status: 200 len: 217 time: 0.0362549 Sep 01 17:08:33.090507 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ca2cd4-1613-4ed2-90f1-96c261be5436 req-1d10fe9c-1f59-4004-bd4c-c97532a65061 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:33.092024 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37ca2cd4-1613-4ed2-90f1-96c261be5436 req-1d10fe9c-1f59-4004-bd4c-c97532a65061 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 200 len: 850 time: 0.0475698 Sep 01 17:08:33.199100 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ca2cd4-1613-4ed2-90f1-96c261be5436 req-cc625dcb-e08d-40e0-8fc2-86c25904abfd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:33.201044 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37ca2cd4-1613-4ed2-90f1-96c261be5436 req-cc625dcb-e08d-40e0-8fc2-86c25904abfd service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=35c995f2-96ec-4a35-9f59-05221a09df3f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0980787 Sep 01 17:08:33.205264 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-cec2f6d1-f485-4444-9302-d208280471ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '9a981a6e-2c7d-4c4d-b4cc-f601ed27b585', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.141', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:43:d9:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:04:39Z', 'updated_at': '2021-09-01T17:04:41Z', 'revision_number': 1, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:33.208043 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbd59e18-4e3f-4f77-bf19-f619c7865ea5 req-dc6dfa00-6b82-47a6-80f0-13f194058844 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:33.209609 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cbd59e18-4e3f-4f77-bf19-f619c7865ea5 req-dc6dfa00-6b82-47a6-80f0-13f194058844 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 945 time: 0.2664075 Sep 01 17:08:33.214565 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [req-37ca2cd4-1613-4ed2-90f1-96c261be5436 req-affc6270-50d4-48bf-9bc2-b8c4d5aa7214 service neutron] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93835) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 17:08:33.215533 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37ca2cd4-1613-4ed2-90f1-96c261be5436 req-affc6270-50d4-48bf-9bc2-b8c4d5aa7214 service neutron] 10.222.0.69 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0059357 Sep 01 17:08:33.236990 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cec2f6d1-f485-4444-9302-d208280471ae None None] Checking router: 8724afe3-ad3a-4d4f-94c4-4642b6e0afab for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:08:33.246181 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cec2f6d1-f485-4444-9302-d208280471ae None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:08:33.246807 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-cec2f6d1-f485-4444-9302-d208280471ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:08:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:33.249136 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-cbd59e18-4e3f-4f77-bf19-f619c7865ea5 req-946ec757-b61d-41f3-afc1-1f939abcab5e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325370 Sep 01 17:08:33.311765 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37ca2cd4-1613-4ed2-90f1-96c261be5436 req-abf9c016-629a-4407-a724-ff46181c78d4 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861871 Sep 01 17:08:33.350412 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-cec2f6d1-f485-4444-9302-d208280471ae None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:08:33.407697 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-37ca2cd4-1613-4ed2-90f1-96c261be5436 req-ca65a820-449d-4c49-8909-aa7fab2a2284 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874650 Sep 01 17:08:33.577244 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-cec2f6d1-f485-4444-9302-d208280471ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '9a981a6e-2c7d-4c4d-b4cc-f601ed27b585', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.141', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:43:d9:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:04:39Z', 'updated_at': '2021-09-01T17:04:41Z', 'revision_number': 1, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:33.603405 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cec2f6d1-f485-4444-9302-d208280471ae None None] The sync data for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi is: [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '9a981a6e-2c7d-4c4d-b4cc-f601ed27b585', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'floating_ip_address': '172.27.1.141', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'port_id': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'mac_address': 'fa:16:3e:43:d9:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:04:39Z', 'updated_at': '2021-09-01T17:04:41Z', 'revision_number': 1, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:08:33.807549 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf0f0d6e-5ac2-4fce-8ae9-100b4ffcf695 None None] New status for floating IP 12a90566-a278-4229-9133-995dae47b145: DOWN {{(pid=93837) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:08:34.419027 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc063942-2f31-4038-806e-22a07edaac04 req-39792b84-42b1-4209-8516-0f70f7712b8a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:34.420496 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fc063942-2f31-4038-806e-22a07edaac04 req-39792b84-42b1-4209-8516-0f70f7712b8a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 945 time: 0.1009271 Sep 01 17:08:34.465645 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fc063942-2f31-4038-806e-22a07edaac04 req-d6659d30-ef93-4c88-b63c-0dd2f5c35f41 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391684 Sep 01 17:08:34.824827 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be0cdfb-fb27-4534-b5e2-d04a90efb360 req-f5f97112-8f34-4c15-9704-1b290d7f786a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:34.826295 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7be0cdfb-fb27-4534-b5e2-d04a90efb360 req-f5f97112-8f34-4c15-9704-1b290d7f786a tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 945 time: 0.0488279 Sep 01 17:08:34.915571 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-7be0cdfb-fb27-4534-b5e2-d04a90efb360 req-be7d00f3-9ba2-4101-91c0-9899b2ec7ddc tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Deleting port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:34.915916 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-7be0cdfb-fb27-4534-b5e2-d04a90efb360 req-be7d00f3-9ba2-4101-91c0-9899b2ec7ddc tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:35.006939 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-7be0cdfb-fb27-4534-b5e2-d04a90efb360 req-be7d00f3-9ba2-4101-91c0-9899b2ec7ddc tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] For port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:35.007310 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-7be0cdfb-fb27-4534-b5e2-d04a90efb360 req-be7d00f3-9ba2-4101-91c0-9899b2ec7ddc tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:35.020564 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-7be0cdfb-fb27-4534-b5e2-d04a90efb360 req-be7d00f3-9ba2-4101-91c0-9899b2ec7ddc tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Calling delete_port for f321a7eb-78b4-4ce9-b5ea-dc1dade4921b owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:35.154777 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-7be0cdfb-fb27-4534-b5e2-d04a90efb360 req-be7d00f3-9ba2-4101-91c0-9899b2ec7ddc tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:35.182778 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be7d00f3-9ba2-4101-91c0-9899b2ec7ddc tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event deleted for resources: {'Port': ['ID=f321a7eb-78b4-4ce9-b5ea-dc1dade4921b,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:35.223352 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-7be0cdfb-fb27-4534-b5e2-d04a90efb360 req-be7d00f3-9ba2-4101-91c0-9899b2ec7ddc tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] No DVR routers for this DVR port f321a7eb-78b4-4ce9-b5ea-dc1dade4921b on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:08:35.225897 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-7be0cdfb-fb27-4534-b5e2-d04a90efb360 req-be7d00f3-9ba2-4101-91c0-9899b2ec7ddc tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:35.228161 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7be0cdfb-fb27-4534-b5e2-d04a90efb360 req-be7d00f3-9ba2-4101-91c0-9899b2ec7ddc tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "DELETE /v2.0/ports/f321a7eb-78b4-4ce9-b5ea-dc1dade4921b HTTP/1.1" status: 204 len: 173 time: 0.3952785 Sep 01 17:08:35.228596 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'name': 'network-vif-deleted', 'tag': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:08:35.230854 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a346807d-c057-49ce-a772-3fa48b1527cf" -d '{"events": [{"server_uuid": "9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89", "name": "network-vif-deleted", "tag": "f321a7eb-78b4-4ce9-b5ea-dc1dade4921b"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:08:35.270352 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:08:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5ca37fe9-6a53-4a0b-84ac-2805980c4f7a x-openstack-request-id: req-5ca37fe9-6a53-4a0b-84ac-2805980c4f7a {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:08:35.270653 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89", "name": "network-vif-deleted", "tag": "f321a7eb-78b4-4ce9-b5ea-dc1dade4921b", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:08:35.270907 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-5ca37fe9-6a53-4a0b-84ac-2805980c4f7a {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:08:35.271312 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89', 'name': 'network-vif-deleted', 'tag': 'f321a7eb-78b4-4ce9-b5ea-dc1dade4921b', 'status': 'completed', 'code': 200} Sep 01 17:08:35.479679 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e95ef635-9ca4-441d-a6c0-81718dea2264 req-3a1c1e0b-8a72-4f0d-96bf-58ed034f328a service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0410862 Sep 01 17:08:35.562557 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-f006902a-9bb7-4ef2-a89f-3a61b35632fd req-70a1f6cf-e067-4b82-b27a-dc7d6b30fde1 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=9d2399f5-3a0d-4ce8-aa7f-34f4814dfa89 HTTP/1.1" status: 200 len: 210 time: 0.0284905 Sep 01 17:08:35.584714 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e95ef635-9ca4-441d-a6c0-81718dea2264 req-9a03608b-3fff-4ff1-99f7-dc1efd2d027a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:35.587497 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e95ef635-9ca4-441d-a6c0-81718dea2264 req-9a03608b-3fff-4ff1-99f7-dc1efd2d027a service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 1099 time: 0.0615296 Sep 01 17:08:35.705999 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e95ef635-9ca4-441d-a6c0-81718dea2264 req-b64cbdf9-2181-433d-ab7d-92a54fb22dac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:35.707476 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e95ef635-9ca4-441d-a6c0-81718dea2264 req-b64cbdf9-2181-433d-ab7d-92a54fb22dac service neutron] 10.222.0.69 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 912 time: 0.0868733 Sep 01 17:08:35.779379 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e95ef635-9ca4-441d-a6c0-81718dea2264 req-7d3d329e-79d1-498b-97cc-5a0dfd429b77 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=71676e7c-69ca-4cba-8a82-4673e0fb57c6 HTTP/1.1" status: 200 len: 1002 time: 0.0639508 Sep 01 17:08:35.830289 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e95ef635-9ca4-441d-a6c0-81718dea2264 req-0d31decd-b4ac-41ac-ba36-b0d00f9b7371 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:35.831693 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e95ef635-9ca4-441d-a6c0-81718dea2264 req-0d31decd-b4ac-41ac-ba36-b0d00f9b7371 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 200 len: 850 time: 0.0415378 Sep 01 17:08:35.881198 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e95ef635-9ca4-441d-a6c0-81718dea2264 req-7216fff6-6d88-4378-82f1-c19da3481e90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:35.882812 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e95ef635-9ca4-441d-a6c0-81718dea2264 req-7216fff6-6d88-4378-82f1-c19da3481e90 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=35c995f2-96ec-4a35-9f59-05221a09df3f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0399113 Sep 01 17:08:35.981620 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e95ef635-9ca4-441d-a6c0-81718dea2264 req-39652b7f-5b26-46d2-93e2-555db96b5296 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0910628 Sep 01 17:08:36.073838 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e95ef635-9ca4-441d-a6c0-81718dea2264 req-19a75e08-759f-451f-b997-730e9d744083 service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838783 Sep 01 17:08:37.954851 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device f321a7eb-78b4-4ce9-b5ea-dc1dade4921b no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:37.974827 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: f321a7eb-78b4-4ce9-b5ea-dc1dade4921b {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:37.975161 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device f321a7eb-78b4-4ce9-b5ea-dc1dade4921b not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:38.836741 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32820) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:38.993329 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-ecdd54a3-591e-4b84-af2e-80d93cc99d8e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Deleting port 0adf1b8c-eaef-467e-b61f-5318d84457da {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:38.993707 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ecdd54a3-591e-4b84-af2e-80d93cc99d8e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:39.077507 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ecdd54a3-591e-4b84-af2e-80d93cc99d8e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:39.077842 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ecdd54a3-591e-4b84-af2e-80d93cc99d8e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:39.090087 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-ecdd54a3-591e-4b84-af2e-80d93cc99d8e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Calling delete_port for 0adf1b8c-eaef-467e-b61f-5318d84457da owned by network:floatingip {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:39.240388 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ecdd54a3-591e-4b84-af2e-80d93cc99d8e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:39.265500 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecdd54a3-591e-4b84-af2e-80d93cc99d8e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event deleted for resources: {'Port': ['ID=0adf1b8c-eaef-467e-b61f-5318d84457da,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:39.328554 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ecdd54a3-591e-4b84-af2e-80d93cc99d8e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for floatingip, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:39.328797 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.l3_db [None req-ecdd54a3-591e-4b84-af2e-80d93cc99d8e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Floating IP 9a981a6e-2c7d-4c4d-b4cc-f601ed27b585 disassociated (deleted). External IP: 172.27.1.141, port: 71676e7c-69ca-4cba-8a82-4673e0fb57c6. Sep 01 17:08:39.778571 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ecdd54a3-591e-4b84-af2e-80d93cc99d8e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:08:39.890684 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ecdd54a3-591e-4b84-af2e-80d93cc99d8e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:08:39.895436 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-ecdd54a3-591e-4b84-af2e-80d93cc99d8e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:39.900178 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a409c448-91aa-4ff5-9512-9907303abdab None None] Sync routers for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:08:39.909146 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a409c448-91aa-4ff5-9512-9907303abdab None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:08:39.909887 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-a409c448-91aa-4ff5-9512-9907303abdab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:08:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:39.925122 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-ecdd54a3-591e-4b84-af2e-80d93cc99d8e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "DELETE /v2.0/floatingips/9a981a6e-2c7d-4c4d-b4cc-f601ed27b585 HTTP/1.1" status: 204 len: 168 time: 1.0850043 Sep 01 17:08:39.925122 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'tag': '71676e7c-69ca-4cba-8a82-4673e0fb57c6'}] {{(pid=93836) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:08:39.925895 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}60a7e58791dd3a103db7a0d35103b09d0a4cb2c205e1177c181e158a6fe3866f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d948db71-e90f-4301-a9f9-b3b57e0e9523" -d '{"events": [{"name": "network-changed", "server_uuid": "193e9c06-bfdd-491e-ac1b-fd70c1d8d243", "tag": "71676e7c-69ca-4cba-8a82-4673e0fb57c6"}]}' {{(pid=93836) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:08:39.962459 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:08:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3cf765b3-767b-49dc-b83c-8c2bc813f4ea x-openstack-request-id: req-3cf765b3-767b-49dc-b83c-8c2bc813f4ea {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:08:39.962874 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "193e9c06-bfdd-491e-ac1b-fd70c1d8d243", "tag": "71676e7c-69ca-4cba-8a82-4673e0fb57c6", "status": "completed", "code": 200}]} {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:08:39.963574 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-3cf765b3-767b-49dc-b83c-8c2bc813f4ea {{(pid=93836) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:08:39.963702 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'tag': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'status': 'completed', 'code': 200} Sep 01 17:08:40.022036 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-a409c448-91aa-4ff5-9512-9907303abdab None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:08:40.034961 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d948db71-e90f-4301-a9f9-b3b57e0e9523 req-c38c5693-fd3e-47c1-89b8-cadbe6f35440 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:40.036701 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d948db71-e90f-4301-a9f9-b3b57e0e9523 req-c38c5693-fd3e-47c1-89b8-cadbe6f35440 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 1099 time: 0.0469050 Sep 01 17:08:40.159819 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d948db71-e90f-4301-a9f9-b3b57e0e9523 req-a9fee1d0-19a7-48a2-b484-52baf6d56563 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:40.161912 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-399248a9-6ec5-4f67-a3ed-8df211a297f7 req-5790ffef-1293-4341-be54-12f81a582e00 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:40.162615 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d948db71-e90f-4301-a9f9-b3b57e0e9523 req-a9fee1d0-19a7-48a2-b484-52baf6d56563 service neutron] 10.222.0.69 "GET /v2.0/networks?id=35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 200 len: 912 time: 0.1106625 Sep 01 17:08:40.163506 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-399248a9-6ec5-4f67-a3ed-8df211a297f7 req-5790ffef-1293-4341-be54-12f81a582e00 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 946 time: 0.0576394 Sep 01 17:08:40.204923 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-399248a9-6ec5-4f67-a3ed-8df211a297f7 req-abcd7605-fe48-4ed3-aa20-bc2f2d976d52 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0347073 Sep 01 17:08:40.217996 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d948db71-e90f-4301-a9f9-b3b57e0e9523 req-3c066361-b70a-475b-a31b-1b8cc0fa6e3f service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=71676e7c-69ca-4cba-8a82-4673e0fb57c6 HTTP/1.1" status: 200 len: 217 time: 0.0458808 Sep 01 17:08:40.260542 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-a409c448-91aa-4ff5-9512-9907303abdab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:40.288218 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a409c448-91aa-4ff5-9512-9907303abdab None None] Checking router: 8724afe3-ad3a-4d4f-94c4-4642b6e0afab for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:08:40.292942 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d948db71-e90f-4301-a9f9-b3b57e0e9523 req-152747a7-10a6-43ec-840c-a9166f9ba048 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:40.295300 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d948db71-e90f-4301-a9f9-b3b57e0e9523 req-152747a7-10a6-43ec-840c-a9166f9ba048 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 200 len: 850 time: 0.0646479 Sep 01 17:08:40.298717 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a409c448-91aa-4ff5-9512-9907303abdab None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:08:40.299554 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-a409c448-91aa-4ff5-9512-9907303abdab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:08:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:40.360392 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d948db71-e90f-4301-a9f9-b3b57e0e9523 req-4bd04a76-6e7f-415f-92b2-503e74eaf348 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:40.361857 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d948db71-e90f-4301-a9f9-b3b57e0e9523 req-4bd04a76-6e7f-415f-92b2-503e74eaf348 service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=35c995f2-96ec-4a35-9f59-05221a09df3f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0441594 Sep 01 17:08:40.371914 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8103738a-274b-4ed7-92d1-7dd311a160d9 req-7e583a5b-eb8c-4314-8e1f-8f516b34aae2 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:40.373588 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8103738a-274b-4ed7-92d1-7dd311a160d9 req-7e583a5b-eb8c-4314-8e1f-8f516b34aae2 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0517275 Sep 01 17:08:40.414816 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-a409c448-91aa-4ff5-9512-9907303abdab None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:08:40.420661 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-8103738a-274b-4ed7-92d1-7dd311a160d9 req-fbdba6c8-3f06-4d6f-92da-b7187fe3d11b tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407126 Sep 01 17:08:40.457166 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d948db71-e90f-4301-a9f9-b3b57e0e9523 req-91e2585d-bc75-4063-a60f-ebf0302304ec service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867782 Sep 01 17:08:40.551662 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-d948db71-e90f-4301-a9f9-b3b57e0e9523 req-13350e47-949d-45a2-80ca-859f2d9342de service neutron] 10.222.0.69 "GET /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866380 Sep 01 17:08:40.615504 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-a409c448-91aa-4ff5-9512-9907303abdab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:40.644543 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a409c448-91aa-4ff5-9512-9907303abdab None None] The sync data for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi is: [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35', 'name': '', 'network_id': '35c995f2-96ec-4a35-9f59-05221a09df3f', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'mac_address': 'fa:16:3e:8c:3d:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_interface', 'standard_attr_id': 428, 'fixed_ips': [{'subnet_id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:45Z', 'updated_at': '2021-09-01T17:00:52Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'subnets': [{'id': 'ab89c120-a892-4afa-a645-bf3caf534f7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:08:40.848278 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-710bab6c-b660-4c1a-b0e6-fe4f6887a812 None None] New status for floating IP 9a981a6e-2c7d-4c4d-b4cc-f601ed27b585: DOWN {{(pid=93837) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:08:41.324586 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f510bd-cadc-402b-873b-63b81edd154d req-cfac1130-721f-4da3-9483-01f3a7fd5a54 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:41.326068 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-67f510bd-cadc-402b-873b-63b81edd154d req-cfac1130-721f-4da3-9483-01f3a7fd5a54 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 946 time: 0.0514209 Sep 01 17:08:41.362838 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-67f510bd-cadc-402b-873b-63b81edd154d req-0c755b47-a173-43fe-93ee-396b4d858372 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/security-groups?id=8ded1df8-6989-4db0-876f-79e2a5cfe05e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0311141 Sep 01 17:08:41.543224 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ebf600-6728-40b8-8021-ad412e250d6b req-aa8d434a-bf54-4eb7-979c-8cbb342ce0a3 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:41.544706 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d2ebf600-6728-40b8-8021-ad412e250d6b req-aa8d434a-bf54-4eb7-979c-8cbb342ce0a3 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0507956 Sep 01 17:08:41.582187 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d2ebf600-6728-40b8-8021-ad412e250d6b req-1e1ba9dc-4586-495e-a632-d8318152e30e tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0314512 Sep 01 17:08:41.951872 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e12bde8-437b-4738-95df-830d26dbb785 req-93c4d39e-b28f-4ddc-af81-9c85c6b71851 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:41.953351 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5e12bde8-437b-4738-95df-830d26dbb785 req-93c4d39e-b28f-4ddc-af81-9c85c6b71851 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 946 time: 0.0489185 Sep 01 17:08:42.047023 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-5e12bde8-437b-4738-95df-830d26dbb785 req-2cb521df-c265-4394-89b8-83c3dd2d0270 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Deleting port 71676e7c-69ca-4cba-8a82-4673e0fb57c6 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:42.047378 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-5e12bde8-437b-4738-95df-830d26dbb785 req-2cb521df-c265-4394-89b8-83c3dd2d0270 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:42.133892 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-5e12bde8-437b-4738-95df-830d26dbb785 req-2cb521df-c265-4394-89b8-83c3dd2d0270 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] For port 71676e7c-69ca-4cba-8a82-4673e0fb57c6, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=71676e7c-69ca-4cba-8a82-4673e0fb57c6,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:42.134258 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-5e12bde8-437b-4738-95df-830d26dbb785 req-2cb521df-c265-4394-89b8-83c3dd2d0270 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:42.146643 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-5e12bde8-437b-4738-95df-830d26dbb785 req-2cb521df-c265-4394-89b8-83c3dd2d0270 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Calling delete_port for 71676e7c-69ca-4cba-8a82-4673e0fb57c6 owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:42.277892 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-5e12bde8-437b-4738-95df-830d26dbb785 req-2cb521df-c265-4394-89b8-83c3dd2d0270 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:42.306836 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cb521df-c265-4394-89b8-83c3dd2d0270 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event deleted for resources: {'Port': ['ID=71676e7c-69ca-4cba-8a82-4673e0fb57c6,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:42.347860 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-5e12bde8-437b-4738-95df-830d26dbb785 req-2cb521df-c265-4394-89b8-83c3dd2d0270 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] No DVR routers for this DVR port 71676e7c-69ca-4cba-8a82-4673e0fb57c6 on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:08:42.350449 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-5e12bde8-437b-4738-95df-830d26dbb785 req-2cb521df-c265-4394-89b8-83c3dd2d0270 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:42.353048 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-5e12bde8-437b-4738-95df-830d26dbb785 req-2cb521df-c265-4394-89b8-83c3dd2d0270 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.69 "DELETE /v2.0/ports/71676e7c-69ca-4cba-8a82-4673e0fb57c6 HTTP/1.1" status: 204 len: 173 time: 0.3931870 Sep 01 17:08:42.353543 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'name': 'network-vif-deleted', 'tag': '71676e7c-69ca-4cba-8a82-4673e0fb57c6'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:08:42.355979 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7d0301d-8535-4cf4-903e-52b140ac405c" -d '{"events": [{"server_uuid": "193e9c06-bfdd-491e-ac1b-fd70c1d8d243", "name": "network-vif-deleted", "tag": "71676e7c-69ca-4cba-8a82-4673e0fb57c6"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:08:42.394516 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:08:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cb0e0da7-c4b7-4a90-9caf-a1f1c321454b x-openstack-request-id: req-cb0e0da7-c4b7-4a90-9caf-a1f1c321454b {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:08:42.394812 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "193e9c06-bfdd-491e-ac1b-fd70c1d8d243", "name": "network-vif-deleted", "tag": "71676e7c-69ca-4cba-8a82-4673e0fb57c6", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:08:42.395070 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-cb0e0da7-c4b7-4a90-9caf-a1f1c321454b {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:08:42.395478 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '193e9c06-bfdd-491e-ac1b-fd70c1d8d243', 'name': 'network-vif-deleted', 'tag': '71676e7c-69ca-4cba-8a82-4673e0fb57c6', 'status': 'completed', 'code': 200} Sep 01 17:08:42.464340 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-07260388-2486-45c9-b4ce-f1687f93bbb8 req-59de467c-6294-47ea-8433-572d64026d67 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "GET /v2.0/ports?device_id=193e9c06-bfdd-491e-ac1b-fd70c1d8d243 HTTP/1.1" status: 200 len: 210 time: 0.0265198 Sep 01 17:08:42.707774 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba6067a5-e930-4600-a308-d0ea98ebfc8e req-a95fe299-0cd0-48d8-884e-cfed600416bb tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:42.709333 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ba6067a5-e930-4600-a308-d0ea98ebfc8e req-a95fe299-0cd0-48d8-884e-cfed600416bb tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0542796 Sep 01 17:08:42.750229 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ba6067a5-e930-4600-a308-d0ea98ebfc8e req-99e37c5a-dc21-497d-bbe0-bee4280da7c1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0337410 Sep 01 17:08:43.520545 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32854) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:43.641321 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-9e47db97-f18b-40f5-9530-4d814abeaa0e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Deleting port ca6fe9b1-6e45-4190-8340-b26649effa55 {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:43.641698 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9e47db97-f18b-40f5-9530-4d814abeaa0e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:43.714132 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9e47db97-f18b-40f5-9530-4d814abeaa0e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:43.714463 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9e47db97-f18b-40f5-9530-4d814abeaa0e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:43.725637 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-9e47db97-f18b-40f5-9530-4d814abeaa0e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Calling delete_port for ca6fe9b1-6e45-4190-8340-b26649effa55 owned by network:floatingip {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:43.889615 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9e47db97-f18b-40f5-9530-4d814abeaa0e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:43.907814 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7830c9bb-0561-417c-bf31-f6b5bf2d0fda req-92d8e649-edcc-4be3-9449-e5ae1fbe2e08 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:43.909311 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7830c9bb-0561-417c-bf31-f6b5bf2d0fda req-92d8e649-edcc-4be3-9449-e5ae1fbe2e08 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0723078 Sep 01 17:08:43.935989 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e47db97-f18b-40f5-9530-4d814abeaa0e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event deleted for resources: {'Port': ['ID=ca6fe9b1-6e45-4190-8340-b26649effa55,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:44.014120 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7830c9bb-0561-417c-bf31-f6b5bf2d0fda req-8e289b67-2fee-4182-8fe1-aadf3d7fe96a tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0799403 Sep 01 17:08:44.024826 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9e47db97-f18b-40f5-9530-4d814abeaa0e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for floatingip, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:44.027690 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-9e47db97-f18b-40f5-9530-4d814abeaa0e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:44.028862 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-9e47db97-f18b-40f5-9530-4d814abeaa0e tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "DELETE /v2.0/floatingips/b33920bd-7a8f-47e0-98fb-6aec89374880 HTTP/1.1" status: 204 len: 168 time: 0.5073283 Sep 01 17:08:45.128321 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a584288b-912a-4873-b971-d1fa8a25b1e2 req-735a58fa-fcca-4013-a4ec-c6c6ebf38b1b tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:45.129811 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a584288b-912a-4873-b971-d1fa8a25b1e2 req-735a58fa-fcca-4013-a4ec-c6c6ebf38b1b tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0486479 Sep 01 17:08:45.167714 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-a584288b-912a-4873-b971-d1fa8a25b1e2 req-6182f17c-d533-4a08-9727-9491cf48ef46 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0317552 Sep 01 17:08:45.221371 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32870) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:45.283474 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0ad2da82-c237-439f-870c-2c2246fa60a0 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:45.309704 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0ad2da82-c237-439f-870c-2c2246fa60a0 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:45.369511 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0ad2da82-c237-439f-870c-2c2246fa60a0 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:45.372126 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0ad2da82-c237-439f-870c-2c2246fa60a0 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:45.373277 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-0ad2da82-c237-439f-870c-2c2246fa60a0 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] 10.222.0.67 "DELETE /v2.0/security-groups/8ded1df8-6989-4db0-876f-79e2a5cfe05e HTTP/1.1" status: 204 len: 168 time: 0.1509223 Sep 01 17:08:45.383666 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ad2da82-c237-439f-870c-2c2246fa60a0 tempest-TestVolumeBootPattern-1075242352 tempest-TestVolumeBootPattern-1075242352-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ded1df8-6989-4db0-876f-79e2a5cfe05e,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:45.430929 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32874) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:45.873056 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b75bd235-904d-46bc-bef4-9edcb5a098b1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1832465'] for router_interface, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:46.043461 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 71676e7c-69ca-4cba-8a82-4673e0fb57c6 no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:46.064406 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: 71676e7c-69ca-4cba-8a82-4673e0fb57c6 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:46.064761 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device 71676e7c-69ca-4cba-8a82-4673e0fb57c6 not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:46.120288 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-b75bd235-904d-46bc-bef4-9edcb5a098b1 admin admin] Deleting port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:46.120632 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b75bd235-904d-46bc-bef4-9edcb5a098b1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:46.202504 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [None req-b75bd235-904d-46bc-bef4-9edcb5a098b1 admin admin] For port 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:46.203040 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b75bd235-904d-46bc-bef4-9edcb5a098b1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:46.216341 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-b75bd235-904d-46bc-bef4-9edcb5a098b1 admin admin] Calling delete_port for 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 owned by network:router_interface {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:46.325790 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3423b4-297b-4987-bf5d-359283d82e0f req-733d8743-75a6-4aa8-bc8d-c6a6203a4c39 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:46.327280 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3e3423b4-297b-4987-bf5d-359283d82e0f req-733d8743-75a6-4aa8-bc8d-c6a6203a4c39 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0727990 Sep 01 17:08:46.408745 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3e3423b4-297b-4987-bf5d-359283d82e0f req-ee9ad545-677e-4c4e-bb5d-17b7f265d4c4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0516026 Sep 01 17:08:46.463980 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b75bd235-904d-46bc-bef4-9edcb5a098b1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:46.492935 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b75bd235-904d-46bc-bef4-9edcb5a098b1 admin admin] Pushing event deleted for resources: {'Port': ['ID=9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:46.658130 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b75bd235-904d-46bc-bef4-9edcb5a098b1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611377', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1832589'] for router_interface, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:46.872525 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b75bd235-904d-46bc-bef4-9edcb5a098b1 admin admin] Router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:08:46.990627 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b75bd235-904d-46bc-bef4-9edcb5a098b1 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:08:46.996272 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-b75bd235-904d-46bc-bef4-9edcb5a098b1 admin admin] 10.222.0.67 "PUT /v2.0/routers/8724afe3-ad3a-4d4f-94c4-4642b6e0afab/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5643065 Sep 01 17:08:46.998844 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32880) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:47.001928 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-985fbf16-bb83-456c-9f2e-0504b968f0a9 None None] Sync routers for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:08:47.012326 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-985fbf16-bb83-456c-9f2e-0504b968f0a9 None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:08:47.012978 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-985fbf16-bb83-456c-9f2e-0504b968f0a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:08:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:47.103803 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] Notify callbacks [] for router, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:47.220322 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-985fbf16-bb83-456c-9f2e-0504b968f0a9 None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:08:47.403547 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-985fbf16-bb83-456c-9f2e-0504b968f0a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:08:46Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:47.429284 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-985fbf16-bb83-456c-9f2e-0504b968f0a9 None None] Checking router: 8724afe3-ad3a-4d4f-94c4-4642b6e0afab for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:08:47.439741 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-985fbf16-bb83-456c-9f2e-0504b968f0a9 None None] Routers {'8724afe3-ad3a-4d4f-94c4-4642b6e0afab'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:08:47.440597 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-985fbf16-bb83-456c-9f2e-0504b968f0a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:08:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:47.453494 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:47.539826 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f53fb9e-dd2d-4a2c-9cc5-abe7531a00d8 req-5c45c010-10e6-426a-b839-d6f3c26ff1d2 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:47.541513 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7f53fb9e-dd2d-4a2c-9cc5-abe7531a00d8 req-5c45c010-10e6-426a-b839-d6f3c26ff1d2 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0586200 Sep 01 17:08:47.546592 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] Deleting port e5819620-e43f-42d0-85da-97b9b3af57ed {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:47.546769 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:47.548198 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-985fbf16-bb83-456c-9f2e-0504b968f0a9 None None] Set router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:08:47.627489 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7f53fb9e-dd2d-4a2c-9cc5-abe7531a00d8 req-f6f26801-3a30-4048-8a73-fd9af1850a86 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0787969 Sep 01 17:08:47.654594 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] For port e5819620-e43f-42d0-85da-97b9b3af57ed, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=e5819620-e43f-42d0-85da-97b9b3af57ed,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:47.654957 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:47.666962 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] Calling delete_port for e5819620-e43f-42d0-85da-97b9b3af57ed owned by network:router_gateway {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:47.730352 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-985fbf16-bb83-456c-9f2e-0504b968f0a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:08:46Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:47.758310 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-985fbf16-bb83-456c-9f2e-0504b968f0a9 None None] The sync data for ids ['8724afe3-ad3a-4d4f-94c4-4642b6e0afab'] in dv-cinder-799668-16-iscsi is: [{'id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'name': 'tempest-TestVolumeBootPattern-459667960-router', 'tenant_id': '63c213b6da7541a0ba2b290c5e15fe03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44'}], 'enable_snat': True}, 'gw_port_id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:08:46Z', 'revision_number': 5, 'project_id': '63c213b6da7541a0ba2b290c5e15fe03', 'gw_port': {'id': 'e5819620-e43f-42d0-85da-97b9b3af57ed', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2a:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8724afe3-ad3a-4d4f-94c4-4642b6e0afab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 427, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:41Z', 'updated_at': '2021-09-01T17:00:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:08:47.837152 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:47.861647 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] Pushing event deleted for resources: {'Port': ['ID=e5819620-e43f-42d0-85da-97b9b3af57ed,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:47.922881 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1827887'] for router_gateway, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.010643 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1821713', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4617'] for router, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.012715 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.055459 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1821722'] for router, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.056221 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8724afe3-ad3a-4d4f-94c4-4642b6e0afab {{(pid=93836) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 01 17:08:48.061451 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] Notify callbacks [] for router, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.062423 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-1cc15108-39fb-4f57-93d0-b0f8c1e35e42 admin admin] 10.222.0.67 "DELETE /v2.0/routers/8724afe3-ad3a-4d4f-94c4-4642b6e0afab HTTP/1.1" status: 204 len: 168 time: 1.0626726 Sep 01 17:08:48.064928 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32884) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:48.110920 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_v2 [None req-fb86db0c-1ed7-4c57-bcf3-6ac18ba30f3a admin admin] Deleting subnet ab89c120-a892-4afa-a645-bf3caf534f7c {{(pid=93836) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 17:08:48.114202 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fb86db0c-1ed7-4c57-bcf3-6ac18ba30f3a admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.156042 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fb86db0c-1ed7-4c57-bcf3-6ac18ba30f3a admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5815122'] for subnet, precommit_delete_associations {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.236029 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fb86db0c-1ed7-4c57-bcf3-6ac18ba30f3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.292822 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fb86db0c-1ed7-4c57-bcf3-6ac18ba30f3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6279800', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6181087'] for subnet, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.317802 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb86db0c-1ed7-4c57-bcf3-6ac18ba30f3a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ab89c120-a892-4afa-a645-bf3caf534f7c,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:48.323547 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-fb86db0c-1ed7-4c57-bcf3-6ac18ba30f3a admin admin] Notify callbacks [] for subnet, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.325870 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-fb86db0c-1ed7-4c57-bcf3-6ac18ba30f3a admin admin] 10.222.0.67 "DELETE /v2.0/subnets/ab89c120-a892-4afa-a645-bf3caf534f7c HTTP/1.1" status: 204 len: 168 time: 0.2599509 Sep 01 17:08:48.327855 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 32886) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:48.335633 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2b3ac87-7c88-47dc-b13e-b41b5e9c47bd None None] Network 35c995f2-96ec-4a35-9f59-05221a09df3f requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:08:48.410614 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.469488 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Deleting port c50c0965-304f-4835-94c0-6eae2dda2639 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:48.469841 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.535269 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] For port c50c0965-304f-4835-94c0-6eae2dda2639, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=c50c0965-304f-4835-94c0-6eae2dda2639,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:48.535647 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.761746 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc9eaa6-4460-4273-b15b-7afbe7e6692b req-74c4d93c-a70f-46e5-b571-828de9d31730 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:48.763388 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7cc9eaa6-4460-4273-b15b-7afbe7e6692b req-74c4d93c-a70f-46e5-b571-828de9d31730 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0661161 Sep 01 17:08:48.775456 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5393435f-3d4f-469a-84dd-444a8a09f782 None None] DHCP port deletion for 35c995f2-96ec-4a35-9f59-05221a09df3f request from dv-cinder-799668-16-iscsi {{(pid=93837) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 01 17:08:48.790380 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Calling delete_port for c50c0965-304f-4835-94c0-6eae2dda2639 owned by network:dhcp {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:48.836653 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-5393435f-3d4f-469a-84dd-444a8a09f782 None None] Deleting port c50c0965-304f-4835-94c0-6eae2dda2639 {{(pid=93837) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:48.836653 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-5393435f-3d4f-469a-84dd-444a8a09f782 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.843187 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7cc9eaa6-4460-4273-b15b-7afbe7e6692b req-58830ff3-b0bf-491f-b1a1-71ec6a1b4627 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0558150 Sep 01 17:08:48.885319 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.889633 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device e5819620-e43f-42d0-85da-97b9b3af57ed no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:48.911064 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Pushing event deleted for resources: {'Port': ['ID=c50c0965-304f-4835-94c0-6eae2dda2639,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:48.914652 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] No DVR routers for this DVR port c50c0965-304f-4835-94c0-6eae2dda2639 on host dv-cinder-799668-16-iscsi {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:08:48.916600 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: e5819620-e43f-42d0-85da-97b9b3af57ed {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:48.917031 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device e5819620-e43f-42d0-85da-97b9b3af57ed not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:48.917654 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:48.939666 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:48.940111 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 9b2b1af0-c91d-49c5-af3f-c2b7f0ffef35 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:48.940626 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device c50c0965-304f-4835-94c0-6eae2dda2639 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:48.969619 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: c50c0965-304f-4835-94c0-6eae2dda2639 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:48.970063 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device c50c0965-304f-4835-94c0-6eae2dda2639 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:48.978322 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-5393435f-3d4f-469a-84dd-444a8a09f782 None None] For port c50c0965-304f-4835-94c0-6eae2dda2639, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=c50c0965-304f-4835-94c0-6eae2dda2639,segment=NetworkSegment(172bca2a-f8ea-4521-800d-b1528cf503d9),segment_id=172bca2a-f8ea-4521-800d-b1528cf503d9)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:48.978725 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-5393435f-3d4f-469a-84dd-444a8a09f782 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.988749 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:48.991044 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-5393435f-3d4f-469a-84dd-444a8a09f782 None None] Calling delete_port for c50c0965-304f-4835-94c0-6eae2dda2639 owned by network:dhcp {{(pid=93837) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:48.998819 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['35c995f2-96ec-4a35-9f59-05221a09df3f']}} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:49.009311 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '172bca2a-f8ea-4521-800d-b1528cf503d9') {'for_net_delete': True} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:49.009691 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '172bca2a-f8ea-4521-800d-b1528cf503d9') {} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:49.018242 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8197639'] for segment, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:49.032588 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:49.039117 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Releasing vlan 511 on physical network physnet1 to pool {{(pid=93835) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 17:08:49.039747 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7342797'] for segment, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: Traceback (most recent call last): Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: timer() Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: cb(*args, **kw) Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: return func(*args, **kwargs) Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: self._notify() Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: self.callback(batched_events) Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: event.method(event) Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: return f(self, *a, **k) Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._get(url).json() Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: return self.request(url, 'GET', **kwargs) Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 17:08:49.041811 dv-cinder-799668-16-iscsi neutron-server[93835]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 17:08:49.076330 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-5393435f-3d4f-469a-84dd-444a8a09f782 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377'] for port, after_delete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:49.099152 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:49.104363 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5393435f-3d4f-469a-84dd-444a8a09f782 None None] Pushing event deleted for resources: {'Port': ['ID=c50c0965-304f-4835-94c0-6eae2dda2639,revision_number=None']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:49.106483 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:49.108122 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5393435f-3d4f-469a-84dd-444a8a09f782 None None] No DVR routers for this DVR port c50c0965-304f-4835-94c0-6eae2dda2639 on host dv-cinder-799668-16-iscsi {{(pid=93837) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:08:49.108675 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] 10.222.0.67 "DELETE /v2.0/networks/35c995f2-96ec-4a35-9f59-05221a09df3f HTTP/1.1" status: 204 len: 168 time: 0.7794385 Sep 01 17:08:49.111701 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32890) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:49.126191 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc8530da-0da5-4d5d-b9aa-979f17cd07e0 admin admin] Pushing event deleted for resources: {'Network': ['ID=35c995f2-96ec-4a35-9f59-05221a09df3f,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:49.457230 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8dc7d11b-e542-473e-9238-707777525870 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1832465'] for router_interface, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:49.700349 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-8dc7d11b-e542-473e-9238-707777525870 admin admin] Deleting port 51fab0de-35b9-4df2-9417-4ecf2e7d519e {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:49.700678 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8dc7d11b-e542-473e-9238-707777525870 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:49.783298 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [None req-8dc7d11b-e542-473e-9238-707777525870 admin admin] For port 51fab0de-35b9-4df2-9417-4ecf2e7d519e, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=51fab0de-35b9-4df2-9417-4ecf2e7d519e,segment=NetworkSegment(b29f5104-3b2d-4e40-af30-f0607bf9318e),segment_id=b29f5104-3b2d-4e40-af30-f0607bf9318e)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:49.783999 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8dc7d11b-e542-473e-9238-707777525870 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:49.797161 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-8dc7d11b-e542-473e-9238-707777525870 admin admin] Calling delete_port for 51fab0de-35b9-4df2-9417-4ecf2e7d519e owned by network:router_interface {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:49.980156 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e60b8ca4-1ca7-4cfc-a06f-e1cc596ef4e9 req-76dae3be-88e5-44c8-a1fc-8cce74117364 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:49.981713 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e60b8ca4-1ca7-4cfc-a06f-e1cc596ef4e9 req-76dae3be-88e5-44c8-a1fc-8cce74117364 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0702298 Sep 01 17:08:50.050048 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e60b8ca4-1ca7-4cfc-a06f-e1cc596ef4e9 req-320109ac-2523-428c-aac0-01ebc6849a7f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0492711 Sep 01 17:08:50.051104 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8dc7d11b-e542-473e-9238-707777525870 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:50.084878 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc7d11b-e542-473e-9238-707777525870 admin admin] Pushing event deleted for resources: {'Port': ['ID=51fab0de-35b9-4df2-9417-4ecf2e7d519e,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:50.260296 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8dc7d11b-e542-473e-9238-707777525870 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611377', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1832589'] for router_interface, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:50.719449 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8dc7d11b-e542-473e-9238-707777525870 admin admin] Router eaed026e-b8b6-438b-8d43-76d2afcb1335 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:08:50.820615 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8dc7d11b-e542-473e-9238-707777525870 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:08:50.825830 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-8dc7d11b-e542-473e-9238-707777525870 admin admin] 10.222.0.67 "PUT /v2.0/routers/eaed026e-b8b6-438b-8d43-76d2afcb1335/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7127986 Sep 01 17:08:50.828083 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32894) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:50.828987 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a161e4d-8f74-41ec-b05f-7af1e5427425 None None] Sync routers for ids ['eaed026e-b8b6-438b-8d43-76d2afcb1335'] in dv-cinder-799668-16-iscsi {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:08:50.838947 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a161e4d-8f74-41ec-b05f-7af1e5427425 None None] Routers {'eaed026e-b8b6-438b-8d43-76d2afcb1335'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:08:50.839478 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-9a161e4d-8f74-41ec-b05f-7af1e5427425 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:08:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['eaed026e-b8b6-438b-8d43-76d2afcb1335'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:50.931141 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] Notify callbacks [] for router, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:50.941971 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-9a161e4d-8f74-41ec-b05f-7af1e5427425 None None] Set router eaed026e-b8b6-438b-8d43-76d2afcb1335 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:08:51.032159 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:51.090655 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] Deleting port 755518de-49ad-448d-91ea-944a89f41331 {{(pid=93836) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:51.091165 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:51.118450 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-9a161e4d-8f74-41ec-b05f-7af1e5427425 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'name': 'tempest-TestVolumeBootPattern-847636729-router', 'tenant_id': '45595a19a07042cda8672bd206162373', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.177'}], 'enable_snat': True}, 'gw_port_id': '755518de-49ad-448d-91ea-944a89f41331', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:48Z', 'updated_at': '2021-09-01T17:08:49Z', 'revision_number': 5, 'project_id': '45595a19a07042cda8672bd206162373', 'gw_port': {'id': '755518de-49ad-448d-91ea-944a89f41331', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:e2:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'device_owner': 'network:router_gateway', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:00:49Z', 'updated_at': '2021-09-01T17:00:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:51.148438 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a161e4d-8f74-41ec-b05f-7af1e5427425 None None] Checking router: eaed026e-b8b6-438b-8d43-76d2afcb1335 for host: dv-cinder-799668-16-iscsi {{(pid=93837) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:08:51.157823 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a161e4d-8f74-41ec-b05f-7af1e5427425 None None] Routers {'eaed026e-b8b6-438b-8d43-76d2afcb1335'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93837) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:08:51.158440 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-9a161e4d-8f74-41ec-b05f-7af1e5427425 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:08:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['eaed026e-b8b6-438b-8d43-76d2afcb1335'], 'active': True} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:51.208465 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5f3db0-f855-4413-834f-e48ab5a7df13 req-1f3b68af-19d8-48da-aade-d0726d8dc6c2 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:51.211138 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-af5f3db0-f855-4413-834f-e48ab5a7df13 req-1f3b68af-19d8-48da-aade-d0726d8dc6c2 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0759785 Sep 01 17:08:51.229590 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.db [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] For port 755518de-49ad-448d-91ea-944a89f41331, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=755518de-49ad-448d-91ea-944a89f41331,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93836) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:51.229998 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:51.250428 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.plugins.ml2.plugin [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] Calling delete_port for 755518de-49ad-448d-91ea-944a89f41331 owned by network:router_gateway {{(pid=93836) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:51.252699 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvr_db [None req-9a161e4d-8f74-41ec-b05f-7af1e5427425 None None] Set router eaed026e-b8b6-438b-8d43-76d2afcb1335 gateway port host: None {{(pid=93837) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:08:51.254608 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-1a92b4da-b06a-4290-baaa-1e524cc8f6bd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:51.280155 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-af5f3db0-f855-4413-834f-e48ab5a7df13 req-a034c255-9a4d-4ab4-b38d-0d0cbde52746 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0615621 Sep 01 17:08:51.306948 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_hamode_db [None req-9a161e4d-8f74-41ec-b05f-7af1e5427425 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'name': 'tempest-TestVolumeBootPattern-847636729-router', 'tenant_id': '45595a19a07042cda8672bd206162373', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:48Z', 'updated_at': '2021-09-01T17:08:51Z', 'revision_number': 6, 'project_id': '45595a19a07042cda8672bd206162373', 'gw_port_host': None}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93837) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:51.336561 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a161e4d-8f74-41ec-b05f-7af1e5427425 None None] The sync data for ids ['eaed026e-b8b6-438b-8d43-76d2afcb1335'] in dv-cinder-799668-16-iscsi is: [{'id': 'eaed026e-b8b6-438b-8d43-76d2afcb1335', 'name': 'tempest-TestVolumeBootPattern-847636729-router', 'tenant_id': '45595a19a07042cda8672bd206162373', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:00:48Z', 'updated_at': '2021-09-01T17:08:51Z', 'revision_number': 6, 'project_id': '45595a19a07042cda8672bd206162373', 'gw_port_host': None}] {{(pid=93837) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:08:51.478108 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:51.511179 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] Pushing event deleted for resources: {'Port': ['ID=755518de-49ad-448d-91ea-944a89f41331,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:51.544769 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10294d43-d3f2-4ee4-9a5d-e47c1dc1ee82 req-88ef7f51-07aa-4f40-9d42-69b46b160a95 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:51.546296 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-10294d43-d3f2-4ee4-9a5d-e47c1dc1ee82 req-88ef7f51-07aa-4f40-9d42-69b46b160a95 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.1071315 Sep 01 17:08:51.559155 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28559e4-8f3d-452b-903f-597325e859ea req-1e7c59d9-07e3-4de7-bb43-c77984d48c2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:51.560651 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e28559e4-8f3d-452b-903f-597325e859ea req-1e7c59d9-07e3-4de7-bb43-c77984d48c2c service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c&device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 1099 time: 0.0416379 Sep 01 17:08:51.599289 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1827887'] for router_gateway, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:51.657892 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28559e4-8f3d-452b-903f-597325e859ea req-87bc7793-1d9b-4062-a9fd-64e37a128812 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:51.659291 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e28559e4-8f3d-452b-903f-597325e859ea req-87bc7793-1d9b-4062-a9fd-64e37a128812 service neutron] 10.222.0.69 "GET /v2.0/networks?id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25 HTTP/1.1" status: 200 len: 912 time: 0.0873294 Sep 01 17:08:51.668649 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-10294d43-d3f2-4ee4-9a5d-e47c1dc1ee82 req-df96a28f-264d-4020-9fcc-1e23f7eeb9b7 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1039984 Sep 01 17:08:51.704612 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1821713', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4617'] for router, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:51.706902 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:51.746421 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e28559e4-8f3d-452b-903f-597325e859ea req-56da9eb0-2fd0-49eb-bb36-01b23156279e service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=bb2db631-7e1f-45bc-b23c-b3e3181a12ab HTTP/1.1" status: 200 len: 1002 time: 0.0747972 Sep 01 17:08:51.752748 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1821722'] for router, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:51.753320 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] Fanout notify agent at l3_agent the message router_deleted on router eaed026e-b8b6-438b-8d43-76d2afcb1335 {{(pid=93836) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 01 17:08:51.757836 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] Notify callbacks [] for router, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:51.761460 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-6d48a4f7-7a6b-4673-a10e-29f1f77a29de admin admin] 10.222.0.67 "DELETE /v2.0/routers/eaed026e-b8b6-438b-8d43-76d2afcb1335 HTTP/1.1" status: 204 len: 168 time: 0.9299841 Sep 01 17:08:51.761895 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32902) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:51.803094 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28559e4-8f3d-452b-903f-597325e859ea req-19a783b6-d51c-4db1-bd48-5a0ea3c68ff2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:51.804770 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e28559e4-8f3d-452b-903f-597325e859ea req-19a783b6-d51c-4db1-bd48-5a0ea3c68ff2 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=638b3e89-f5ce-4389-adde-079fe5b332cd HTTP/1.1" status: 200 len: 850 time: 0.0473261 Sep 01 17:08:51.810020 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_v2 [None req-21256a37-ac6b-4847-baf4-2fb2b2eb1f72 admin admin] Deleting subnet 83cfc7d8-6589-4159-a8f7-3faa0a2f904f {{(pid=93836) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 17:08:51.813015 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-21256a37-ac6b-4847-baf4-2fb2b2eb1f72 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:51.846474 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-21256a37-ac6b-4847-baf4-2fb2b2eb1f72 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5815122'] for subnet, precommit_delete_associations {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:51.853363 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28559e4-8f3d-452b-903f-597325e859ea req-5de4b491-3e7f-4323-8514-67eedb6b1a4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:51.854823 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e28559e4-8f3d-452b-903f-597325e859ea req-5de4b491-3e7f-4323-8514-67eedb6b1a4e service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0412936 Sep 01 17:08:51.927161 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-21256a37-ac6b-4847-baf4-2fb2b2eb1f72 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:51.951782 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e28559e4-8f3d-452b-903f-597325e859ea req-a21f40cb-2744-4119-ab3a-0892a01df1b2 service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852528 Sep 01 17:08:51.979672 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-21256a37-ac6b-4847-baf4-2fb2b2eb1f72 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6279800', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6181087'] for subnet, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.004510 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21256a37-ac6b-4847-baf4-2fb2b2eb1f72 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=83cfc7d8-6589-4159-a8f7-3faa0a2f904f,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:52.008710 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-21256a37-ac6b-4847-baf4-2fb2b2eb1f72 admin admin] Notify callbacks [] for subnet, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.010594 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-21256a37-ac6b-4847-baf4-2fb2b2eb1f72 admin admin] 10.222.0.67 "DELETE /v2.0/subnets/83cfc7d8-6589-4159-a8f7-3faa0a2f904f HTTP/1.1" status: 204 len: 168 time: 0.2475548 Sep 01 17:08:52.013212 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 32904) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:52.016335 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ad7b0dd-7e9d-4f0d-8b93-1b14d47087b5 None None] Network 5b6358fd-941d-4575-bad3-2592e08ee13f requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:08:52.108711 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.112597 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-e28559e4-8f3d-452b-903f-597325e859ea req-5c7862a2-76af-4ade-b9db-d9258d2f1f17 service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1525042 Sep 01 17:08:52.171386 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Deleting port 2428f97b-7581-4636-8957-db3a5330a720 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:52.171725 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.194448 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8faa01d9-7cc3-45bc-8668-84b488cf4237 None None] DHCP port deletion for 5b6358fd-941d-4575-bad3-2592e08ee13f request from dv-cinder-799668-16-iscsi {{(pid=93837) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 01 17:08:52.242758 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] For port 2428f97b-7581-4636-8957-db3a5330a720, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=2428f97b-7581-4636-8957-db3a5330a720,segment=NetworkSegment(b29f5104-3b2d-4e40-af30-f0607bf9318e),segment_id=b29f5104-3b2d-4e40-af30-f0607bf9318e)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:52.243130 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.249001 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-8faa01d9-7cc3-45bc-8668-84b488cf4237 None None] Deleting port 2428f97b-7581-4636-8957-db3a5330a720 {{(pid=93837) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:08:52.249409 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-8faa01d9-7cc3-45bc-8668-84b488cf4237 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.255724 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Calling delete_port for 2428f97b-7581-4636-8957-db3a5330a720 owned by network:dhcp {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:52.312505 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-8faa01d9-7cc3-45bc-8668-84b488cf4237 None None] For port 2428f97b-7581-4636-8957-db3a5330a720, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=2428f97b-7581-4636-8957-db3a5330a720,segment=NetworkSegment(b29f5104-3b2d-4e40-af30-f0607bf9318e),segment_id=b29f5104-3b2d-4e40-af30-f0607bf9318e)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:08:52.312907 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-8faa01d9-7cc3-45bc-8668-84b488cf4237 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.326009 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-8faa01d9-7cc3-45bc-8668-84b488cf4237 None None] Calling delete_port for 2428f97b-7581-4636-8957-db3a5330a720 owned by network:dhcp {{(pid=93837) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:08:52.338092 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.368921 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Pushing event deleted for resources: {'Port': ['ID=2428f97b-7581-4636-8957-db3a5330a720,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:52.372892 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] No DVR routers for this DVR port 2428f97b-7581-4636-8957-db3a5330a720 on host dv-cinder-799668-16-iscsi {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:08:52.416429 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-8faa01d9-7cc3-45bc-8668-84b488cf4237 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377'] for port, after_delete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.441297 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8faa01d9-7cc3-45bc-8668-84b488cf4237 None None] Pushing event deleted for resources: {'Port': ['ID=2428f97b-7581-4636-8957-db3a5330a720,revision_number=None']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:52.445596 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8faa01d9-7cc3-45bc-8668-84b488cf4237 None None] No DVR routers for this DVR port 2428f97b-7581-4636-8957-db3a5330a720 on host dv-cinder-799668-16-iscsi {{(pid=93837) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:08:52.454718 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.465326 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5b6358fd-941d-4575-bad3-2592e08ee13f']}} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:52.476027 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b29f5104-3b2d-4e40-af30-f0607bf9318e') {'for_net_delete': True} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:52.476448 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b29f5104-3b2d-4e40-af30-f0607bf9318e') {} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:08:52.485076 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8197639'] for segment, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.499720 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.505963 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Releasing vlan 524 on physical network physnet1 to pool {{(pid=93835) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 17:08:52.506389 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7342797'] for segment, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: Traceback (most recent call last): Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: timer() Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: cb(*args, **kw) Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: return func(*args, **kwargs) Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: self._notify() Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: self.callback(batched_events) Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: event.method(event) Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: return f(self, *a, **k) Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._get(url).json() Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: return self.request(url, 'GET', **kwargs) Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 17:08:52.509440 dv-cinder-799668-16-iscsi neutron-server[93835]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 17:08:52.575966 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.581514 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.585874 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] 10.222.0.67 "DELETE /v2.0/networks/5b6358fd-941d-4575-bad3-2592e08ee13f HTTP/1.1" status: 204 len: 168 time: 0.5691304 Sep 01 17:08:52.595006 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c416c69-f81e-4007-949e-0c8df54a375c admin admin] Pushing event deleted for resources: {'Network': ['ID=5b6358fd-941d-4575-bad3-2592e08ee13f,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:52.659648 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 51fab0de-35b9-4df2-9417-4ecf2e7d519e no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:52.681305 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 51fab0de-35b9-4df2-9417-4ecf2e7d519e {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:52.681670 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 51fab0de-35b9-4df2-9417-4ecf2e7d519e not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:52.682092 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 755518de-49ad-448d-91ea-944a89f41331 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:52.701488 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 755518de-49ad-448d-91ea-944a89f41331 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:52.701834 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 755518de-49ad-448d-91ea-944a89f41331 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:52.702259 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 2428f97b-7581-4636-8957-db3a5330a720 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:08:52.727293 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32910) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:52.731302 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 2428f97b-7581-4636-8957-db3a5330a720 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:08:52.731696 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 2428f97b-7581-4636-8957-db3a5330a720 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:08:52.799063 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-46c3f7b1-c373-45af-92d9-4ef4e703420d admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=63c213b6da7541a0ba2b290c5e15fe03&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0706048 Sep 01 17:08:52.801631 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 32912) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:52.817556 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c54ecd0-7694-45c9-96bc-cf67d0c22afa req-c2fc24f5-b9ff-422e-9728-84d856d3e40b tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:08:52.819029 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4c54ecd0-7694-45c9-96bc-cf67d0c22afa req-c2fc24f5-b9ff-422e-9728-84d856d3e40b tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0636039 Sep 01 17:08:52.852189 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-319f88e6-fdd1-454b-b0bc-b9c9d78d461d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.856876 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4c54ecd0-7694-45c9-96bc-cf67d0c22afa req-8eb723aa-3f58-4ac9-98b6-4bed5ac9da41 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0312419 Sep 01 17:08:52.875108 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-319f88e6-fdd1-454b-b0bc-b9c9d78d461d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.926325 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-319f88e6-fdd1-454b-b0bc-b9c9d78d461d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.930782 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-319f88e6-fdd1-454b-b0bc-b9c9d78d461d admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:52.932027 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-319f88e6-fdd1-454b-b0bc-b9c9d78d461d admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/88c60630-7058-4105-a30b-633550b14668 HTTP/1.1" status: 204 len: 168 time: 0.1293855 Sep 01 17:08:52.940661 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-319f88e6-fdd1-454b-b0bc-b9c9d78d461d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88c60630-7058-4105-a30b-633550b14668,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:53.260234 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 32920) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:53.302042 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-20a495c3-15e1-47d1-93f5-89e885c5f609 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=45595a19a07042cda8672bd206162373&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0405743 Sep 01 17:08:53.305303 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32922) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:08:53.352964 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c9ec2952-1652-4b00-ad70-f5f84b3e8439 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:53.374140 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c9ec2952-1652-4b00-ad70-f5f84b3e8439 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:53.420483 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c9ec2952-1652-4b00-ad70-f5f84b3e8439 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:53.423064 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c9ec2952-1652-4b00-ad70-f5f84b3e8439 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:53.424224 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c9ec2952-1652-4b00-ad70-f5f84b3e8439 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/ffbe0b26-8c39-4df7-a8db-416b2a40c8cc HTTP/1.1" status: 204 len: 168 time: 0.1178493 Sep 01 17:08:53.433198 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9ec2952-1652-4b00-ad70-f5f84b3e8439 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ffbe0b26-8c39-4df7-a8db-416b2a40c8cc,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:08:53.782259 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:53.797006 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-a9321cc7-52d4-4f6d-8876-97a796cb7e30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:54.940032 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:56.576684 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:56.671826 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:08:57.581680 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:09:21.246107 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-1017de95-9a91-4d49-9a55-6c45ee568814 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:23.782929 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:23.797495 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-f4488667-5415-4a6d-bcf4-6f934362b27d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:24.941343 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:25.751324 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73736e51-21d3-454f-9f4b-c8677e838ac4 req-55cbac62-1734-48ed-85ff-0e21f32f047f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:25.752792 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-73736e51-21d3-454f-9f4b-c8677e838ac4 req-55cbac62-1734-48ed-85ff-0e21f32f047f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0489495 Sep 01 17:09:25.790462 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-73736e51-21d3-454f-9f4b-c8677e838ac4 req-cda4cfef-6132-4618-b2c1-47b5f6929123 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0317528 Sep 01 17:09:26.580256 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:26.684509 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:26.910754 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8d285f9-4d94-4956-a748-e105096edada req-13ef3231-0991-4553-9f77-d16766a68540 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:26.912428 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e8d285f9-4d94-4956-a748-e105096edada req-13ef3231-0991-4553-9f77-d16766a68540 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0514536 Sep 01 17:09:26.949692 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-e8d285f9-4d94-4956-a748-e105096edada req-0e78d4b6-488c-4b25-940b-09eb5e2025be tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0310128 Sep 01 17:09:27.950119 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-06eae6b7-12a5-4219-8a5e-64f55051ec88 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:27.951590 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-06eae6b7-12a5-4219-8a5e-64f55051ec88 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.69 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0505302 Sep 01 17:09:28.045519 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Deleting port bb2db631-7e1f-45bc-b23c-b3e3181a12ab {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:09:28.045880 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:28.063461 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12f632af-3d51-4b44-ad52-d3ca4db52077 req-1e110c1a-c252-4f46-8ec2-7c642030dace tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:28.064946 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-12f632af-3d51-4b44-ad52-d3ca4db52077 req-1e110c1a-c252-4f46-8ec2-7c642030dace tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 946 time: 0.0491409 Sep 01 17:09:28.103393 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-12f632af-3d51-4b44-ad52-d3ca4db52077 req-40190fde-fc83-42cf-923a-0f2d8c191b2d tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=ebc44224-604f-486e-a008-5a58b91c7eb6&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0315027 Sep 01 17:09:28.134765 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] For port bb2db631-7e1f-45bc-b23c-b3e3181a12ab, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=bb2db631-7e1f-45bc-b23c-b3e3181a12ab,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:09:28.135144 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:28.306877 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for floatingip, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:28.307177 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:28.307501 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.l3_db [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Floating IP 7138ab7c-9607-42bc-87c9-96434f678761 disassociated. External IP: 172.27.1.146, port: bb2db631-7e1f-45bc-b23c-b3e3181a12ab. Sep 01 17:09:28.307840 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Calling delete_port for bb2db631-7e1f-45bc-b23c-b3e3181a12ab owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:09:28.433314 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:28.466456 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event deleted for resources: {'Port': ['ID=bb2db631-7e1f-45bc-b23c-b3e3181a12ab,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:09:28.478738 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:28.479092 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:28.479465 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:28.479815 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:28.480147 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:28.480481 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:28.481223 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:28.481223 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:28.481480 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:28.481824 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:28.482152 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:28.482477 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:28.587444 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Router 983dc48a-7f67-4eed-9560-9f50c5b92a36 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:09:28.694759 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:09:28.704332 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d322a49d-9365-49e1-bf91-cc5e0be507a6 None None] Sync routers for ids ['983dc48a-7f67-4eed-9560-9f50c5b92a36'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:09:28.713808 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d322a49d-9365-49e1-bf91-cc5e0be507a6 None None] Routers {'983dc48a-7f67-4eed-9560-9f50c5b92a36'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:09:28.714415 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-d322a49d-9365-49e1-bf91-cc5e0be507a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:09:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['983dc48a-7f67-4eed-9560-9f50c5b92a36'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:09:28.735739 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] No DVR routers for this DVR port bb2db631-7e1f-45bc-b23c-b3e3181a12ab on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:09:28.738292 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:28.741003 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-fbdb736c-2125-4994-99f6-7f1df53a7e5b req-0109fba3-090e-4777-bccd-4d41fca4fef9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.69 "DELETE /v2.0/ports/bb2db631-7e1f-45bc-b23c-b3e3181a12ab HTTP/1.1" status: 204 len: 173 time: 0.7829149 Sep 01 17:09:28.741461 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e47e85e5-f5f1-45ff-aad0-1c58527b7712', 'name': 'network-vif-deleted', 'tag': 'bb2db631-7e1f-45bc-b23c-b3e3181a12ab'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:09:28.743742 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-28961c46-60c2-475f-908c-c85ed2f18d69" -d '{"events": [{"server_uuid": "e47e85e5-f5f1-45ff-aad0-1c58527b7712", "name": "network-vif-deleted", "tag": "bb2db631-7e1f-45bc-b23c-b3e3181a12ab"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:09:28.835056 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-d322a49d-9365-49e1-bf91-cc5e0be507a6 None None] Set router 983dc48a-7f67-4eed-9560-9f50c5b92a36 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:09:28.979612 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:09:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-19a60ed9-219d-4945-8d55-e7eb9bbc7be4 x-openstack-request-id: req-19a60ed9-219d-4945-8d55-e7eb9bbc7be4 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:09:28.980111 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e47e85e5-f5f1-45ff-aad0-1c58527b7712", "name": "network-vif-deleted", "tag": "bb2db631-7e1f-45bc-b23c-b3e3181a12ab", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:09:28.980235 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-19a60ed9-219d-4945-8d55-e7eb9bbc7be4 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:09:28.980547 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e47e85e5-f5f1-45ff-aad0-1c58527b7712', 'name': 'network-vif-deleted', 'tag': 'bb2db631-7e1f-45bc-b23c-b3e3181a12ab', 'status': 'completed', 'code': 200} Sep 01 17:09:29.048232 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-d322a49d-9365-49e1-bf91-cc5e0be507a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:38Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:09:29.078874 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d322a49d-9365-49e1-bf91-cc5e0be507a6 None None] Checking router: 983dc48a-7f67-4eed-9560-9f50c5b92a36 for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:09:29.087435 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d322a49d-9365-49e1-bf91-cc5e0be507a6 None None] Routers {'983dc48a-7f67-4eed-9560-9f50c5b92a36'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:09:29.088040 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-d322a49d-9365-49e1-bf91-cc5e0be507a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:09:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['983dc48a-7f67-4eed-9560-9f50c5b92a36'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:09:29.201510 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-d322a49d-9365-49e1-bf91-cc5e0be507a6 None None] Set router 983dc48a-7f67-4eed-9560-9f50c5b92a36 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:09:29.212951 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-281a1f35-4ecb-4bf9-ba72-0befdb6da86d req-ca18eb8f-74f0-41b1-8a5e-d93cd890ac31 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=e47e85e5-f5f1-45ff-aad0-1c58527b7712 HTTP/1.1" status: 200 len: 210 time: 0.0296926 Sep 01 17:09:29.412611 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-d322a49d-9365-49e1-bf91-cc5e0be507a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:38Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:09:29.438726 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d322a49d-9365-49e1-bf91-cc5e0be507a6 None None] The sync data for ids ['983dc48a-7f67-4eed-9560-9f50c5b92a36'] in dv-cinder-799668-16-iscsi is: [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:38Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:09:29.645481 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd9f8613-4886-4386-8a87-b77a46f3de6c None None] New status for floating IP 7138ab7c-9607-42bc-87c9-96434f678761: DOWN {{(pid=93837) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:09:30.297293 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32964) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:09:30.353925 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:30.379763 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:30.425641 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:30.428992 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:30.430178 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "DELETE /v2.0/security-groups/ebc44224-604f-486e-a008-5a58b91c7eb6 HTTP/1.1" status: 204 len: 168 time: 0.1318390 Sep 01 17:09:30.432850 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 32966) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:09:30.438795 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ebc44224-604f-486e-a008-5a58b91c7eb6,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:09:30.445752 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:30.446105 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:30.446452 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:30.446790 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:30.447123 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:30.447263 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.api.v2.resource [None req-2f532a72-e7e1-44de-9b92-afaed34a113f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] show failed (client error): The resource could not be found. Sep 01 17:09:30.447455 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:30.447787 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:30.448104 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-2f532a72-e7e1-44de-9b92-afaed34a113f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups/ebc44224-604f-486e-a008-5a58b91c7eb6 HTTP/1.1" status: 404 len: 347 time: 0.0137103 Sep 01 17:09:30.448315 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:30.448431 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:30.448747 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:30.449067 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:30.449427 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d701e7-ec52-4d5c-b5db-79cb5694a2ad tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:30.450806 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 32968) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:09:30.576174 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-7ab06857-224f-4071-88b6-4aec68a0cfe9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Deleting port a7feaca6-324a-47e0-b087-6189b8634dd4 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:09:30.576428 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7ab06857-224f-4071-88b6-4aec68a0cfe9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:30.653833 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7ab06857-224f-4071-88b6-4aec68a0cfe9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:30.654170 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7ab06857-224f-4071-88b6-4aec68a0cfe9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:30.666450 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-7ab06857-224f-4071-88b6-4aec68a0cfe9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Calling delete_port for a7feaca6-324a-47e0-b087-6189b8634dd4 owned by network:floatingip {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:09:30.793796 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7ab06857-224f-4071-88b6-4aec68a0cfe9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:30.823489 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ab06857-224f-4071-88b6-4aec68a0cfe9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event deleted for resources: {'Port': ['ID=a7feaca6-324a-47e0-b087-6189b8634dd4,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:09:30.883966 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7ab06857-224f-4071-88b6-4aec68a0cfe9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for floatingip, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:30.886653 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-7ab06857-224f-4071-88b6-4aec68a0cfe9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:30.887830 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-7ab06857-224f-4071-88b6-4aec68a0cfe9 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "DELETE /v2.0/floatingips/7138ab7c-9607-42bc-87c9-96434f678761 HTTP/1.1" status: 204 len: 168 time: 0.4360943 Sep 01 17:09:31.135079 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 32972) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:09:31.139735 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [None req-35b0db4a-c429-4cc9-9554-079c6f1d7832 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Request body: {'security_group': {'name': 'tempest-securitygroup--607036659', 'description': 'tempest-description--172308838'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:09:31.163206 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-35b0db4a-c429-4cc9-9554-079c6f1d7832 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.242731 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-35b0db4a-c429-4cc9-9554-079c6f1d7832 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.246328 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-35b0db4a-c429-4cc9-9554-079c6f1d7832 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.274114 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-35b0db4a-c429-4cc9-9554-079c6f1d7832 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.275321 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-35b0db4a-c429-4cc9-9554-079c6f1d7832 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1778 time: 0.1392365 Sep 01 17:09:31.277417 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35b0db4a-c429-4cc9-9554-079c6f1d7832 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event updated for resources: {'SecurityGroup': ['ID=204e3130-adb5-4253-8299-b942526ba24c,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:09:31.278509 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32974) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:09:31.283349 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-5fb5bd27-77f8-4b77-8231-cebb2c18ccf0 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Request body: {'security_group_rule': {'security_group_id': '204e3130-adb5-4253-8299-b942526ba24c', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:09:31.311748 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5fb5bd27-77f8-4b77-8231-cebb2c18ccf0 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.358463 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5fb5bd27-77f8-4b77-8231-cebb2c18ccf0 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.361848 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5fb5bd27-77f8-4b77-8231-cebb2c18ccf0 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.379533 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fb5bd27-77f8-4b77-8231-cebb2c18ccf0 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2c7714c7-746e-4db7-81ae-b329beae05e8,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:09:31.387199 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5fb5bd27-77f8-4b77-8231-cebb2c18ccf0 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.388502 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-5fb5bd27-77f8-4b77-8231-cebb2c18ccf0 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1089451 Sep 01 17:09:31.391059 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32976) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:09:31.395327 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-674b0c5d-4ecc-4098-b0cb-7cf3941563c6 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Request body: {'security_group_rule': {'security_group_id': '204e3130-adb5-4253-8299-b942526ba24c', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:09:31.422324 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-674b0c5d-4ecc-4098-b0cb-7cf3941563c6 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group_rule, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.477434 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-674b0c5d-4ecc-4098-b0cb-7cf3941563c6 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.480808 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-674b0c5d-4ecc-4098-b0cb-7cf3941563c6 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1664022'] for security_group_rule, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.497605 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-674b0c5d-4ecc-4098-b0cb-7cf3941563c6 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=28f8520b-0737-4cfa-8ea9-c1ccd5d5c9e8,revision_number=0']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:09:31.504334 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-674b0c5d-4ecc-4098-b0cb-7cf3941563c6 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group_rule, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.504994 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-674b0c5d-4ecc-4098-b0cb-7cf3941563c6 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1130276 Sep 01 17:09:31.508029 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 32978) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:09:31.512419 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Request body: {'floatingip': {'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:09:31.533710 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for floatingip, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.629291 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.728501 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.db_base_plugin_common [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Allocated IP 172.27.1.125 (e28b8145-06a4-43a8-a9f2-9a7014f96a23/bb03a81f-6f53-44d6-90e9-69e9ac09604e/d7f345cd-8a9f-48ef-88f5-09f6ff08959a) {{(pid=93836) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:09:31.830939 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for port, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.868501 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6279703'] for port, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:31.902988 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Network e28b8145-06a4-43a8-a9f2-9a7014f96a23 is already hosted by enough agents. {{(pid=93836) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:09:31.907641 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.base_scheduler [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Resources bound (agent type, host, resource id): {{(pid=93836) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:09:31.911081 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Received port after_create {{(pid=93836) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:09:31.934656 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event updated for resources: {'Port': ['ID=d7f345cd-8a9f-48ef-88f5-09f6ff08959a,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:09:31.999480 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for floatingip, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:32.032008 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:32.178322 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for port, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:32.182782 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6279726'] for port, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:32.251618 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event updated for resources: {'Port': ['ID=d7f345cd-8a9f-48ef-88f5-09f6ff08959a,revision_number=2']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:09:32.259398 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:32.273103 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:32.274441 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-8a487594-9cfe-48b5-8ac0-1375494e38c5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.7654946 Sep 01 17:09:32.290374 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device bb2db631-7e1f-45bc-b23c-b3e3181a12ab no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:09:32.310096 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: bb2db631-7e1f-45bc-b23c-b3e3181a12ab {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:09:32.310444 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device bb2db631-7e1f-45bc-b23c-b3e3181a12ab not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:09:32.459741 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-649e8c74-bc56-45e0-9c90-4ace8f356dbf tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?name=tempest-securitygroup--607036659&fields=id&tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c HTTP/1.1" status: 200 len: 267 time: 0.0334105 Sep 01 17:09:32.567104 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-5dc0bbcf-115c-4f62-83fe-a057692bc779 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:32.568501 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-5dc0bbcf-115c-4f62-83fe-a057692bc779 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/networks?id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25 HTTP/1.1" status: 200 len: 811 time: 0.1020818 Sep 01 17:09:32.582837 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-e27d44b4-07cc-4487-b045-1c1a4c4c131b tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/quotas/aef2053b969d4ca58b0e1ec3a7e7a06c HTTP/1.1" status: 200 len: 375 time: 0.0086663 Sep 01 17:09:32.634620 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-8a360638-8218-4ee4-a2c3-72fff926526f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0464747 Sep 01 17:09:32.747811 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-fd82182e-b8fb-4d5d-a71f-9598b6835c79 service neutron] http://10.222.0.67:9696/v2.0/extensions returned with HTTP 200 {{(pid=93836) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 01 17:09:32.748963 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-fd82182e-b8fb-4d5d-a71f-9598b6835c79 service neutron] 10.222.0.67 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1033425 Sep 01 17:09:32.845473 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-bd7ca0ea-ea09-478f-9683-33871b77ab72 service neutron] 10.222.0.67 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0902252 Sep 01 17:09:32.935792 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-a801e5ed-15ca-468c-a21d-eec87181ab4e service neutron] 10.222.0.67 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834525 Sep 01 17:09:34.111317 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d51ad60e-fafd-4a2c-a9ef-05c5536d6f6b req-6935be8a-3b5c-4da2-b2eb-f520c1004520 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 210 time: 0.0262120 Sep 01 17:09:34.580395 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:09:35.121093 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-4605a891-da9a-49f1-957b-25febc52d67c tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:35.122603 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-4605a891-da9a-49f1-957b-25febc52d67c tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.69 "GET /v2.0/networks?id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25 HTTP/1.1" status: 200 len: 811 time: 0.1074188 Sep 01 17:09:35.176633 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-a9d55672-26dc-4547-8895-6baae51601f8 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.69 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c HTTP/1.1" status: 200 len: 379 time: 0.0435209 Sep 01 17:09:35.190524 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-0166619e-55d7-429b-add0-9f2b677a32a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Request body: {'port': {'device_id': '80ca5c13-f887-4075-b98f-f4a00ba5ec82', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'admin_state_up': True, 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'security_groups': ['204e3130-adb5-4253-8299-b942526ba24c']}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:09:35.208558 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-5af1f094-ddb5-42f0-86b1-d7b410ab953e req-3af70603-6a00-4d1b-9842-8dda0cd3085e tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 210 time: 0.0270786 Sep 01 17:09:35.296765 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-0166619e-55d7-429b-add0-9f2b677a32a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Made reservation on behalf of aef2053b969d4ca58b0e1ec3a7e7a06c for: {'port': 1} {{(pid=93835) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 01 17:09:35.300127 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-0166619e-55d7-429b-add0-9f2b677a32a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:35.428492 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_common [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-0166619e-55d7-429b-add0-9f2b677a32a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Allocated IP 172.20.0.8 (adfcf065-5df4-4f7a-9b14-3f96b61d0c25/638b3e89-f5ce-4389-adde-079fe5b332cd/fcb572b9-161c-4749-ac69-c810078aa201) {{(pid=93835) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 01 17:09:35.567397 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-0166619e-55d7-429b-add0-9f2b677a32a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for port, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:35.580865 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-0166619e-55d7-429b-add0-9f2b677a32a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Transition to ACTIVE for port object fcb572b9-161c-4749-ac69-c810078aa201 will not be triggered until provisioned by entity DHCP. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:09:35.612905 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-0166619e-55d7-429b-add0-9f2b677a32a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748408675368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:35.653603 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-0166619e-55d7-429b-add0-9f2b677a32a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 is already hosted by enough agents. {{(pid=93835) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 01 17:09:35.659006 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.base_scheduler [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-0166619e-55d7-429b-add0-9f2b677a32a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Resources bound (agent type, host, resource id): {{(pid=93835) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 01 17:09:35.663310 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-0166619e-55d7-429b-add0-9f2b677a32a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Received port after_create {{(pid=93835) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 01 17:09:35.689250 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0166619e-55d7-429b-add0-9f2b677a32a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event updated for resources: {'Port': ['ID=fcb572b9-161c-4749-ac69-c810078aa201,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:09:35.718825 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-0166619e-55d7-429b-add0-9f2b677a32a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:35.719472 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-0166619e-55d7-429b-add0-9f2b677a32a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:35.734627 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-0166619e-55d7-429b-add0-9f2b677a32a4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.69 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5478549 Sep 01 17:09:35.748885 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.v2.base [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Request body: {'port': {'device_id': '80ca5c13-f887-4075-b98f-f4a00ba5ec82', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79966'}} {{(pid=93835) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:09:35.809293 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:35.848048 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-02051605-d39a-4ead-8e2c-3fc59b710e35 None None] Provisioning for port fcb572b9-161c-4749-ac69-c810078aa201 completed by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:09:35.852120 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-02051605-d39a-4ead-8e2c-3fc59b710e35 None None] Provisioning complete for port fcb572b9-161c-4749-ac69-c810078aa201 triggered by entity DHCP. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:09:35.852494 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-02051605-d39a-4ead-8e2c-3fc59b710e35 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:35.889269 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-02051605-d39a-4ead-8e2c-3fc59b710e35 None None] Port fcb572b9-161c-4749-ac69-c810078aa201 cannot update to ACTIVE because it is not bound. {{(pid=93837) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 01 17:09:36.072728 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fcb572b9-161c-4749-ac69-c810078aa201 {{(pid=93835) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:09:36.079909 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Notify callbacks [] for port, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:36.091312 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.provisioning_blocks [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Transition to ACTIVE for port object fcb572b9-161c-4749-ac69-c810078aa201 will not be triggered until provisioned by entity L2. {{(pid=93835) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 01 17:09:36.095024 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:36.147907 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Pushing event updated for resources: {'Port': ['ID=fcb572b9-161c-4749-ac69-c810078aa201,revision_number=2']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:09:36.217126 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Attempting to bind port fcb572b9-161c-4749-ac69-c810078aa201 on host hv-cinder-79966 for vnic_type normal with profile {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 01 17:09:36.217497 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Attempting to bind port fcb572b9-161c-4749-ac69-c810078aa201 by drivers openvswitch,hyperv on host hv-cinder-79966 at level 0 using segments [{'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 01 17:09:36.217829 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Attempting to bind port fcb572b9-161c-4749-ac69-c810078aa201 on network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:09:36.222359 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Port fcb572b9-161c-4749-ac69-c810078aa201 on network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79966 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 01 17:09:36.222683 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Attempting to bind port fcb572b9-161c-4749-ac69-c810078aa201 on network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 01 17:09:36.227730 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Checking agent: {'id': '39eddcef-ac66-4069-b275-cb9d9871e7ac', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79966', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'started_at': datetime.datetime(2021, 9, 1, 16, 56, 26), 'heartbeat_timestamp': datetime.datetime(2021, 9, 1, 17, 9, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 01 17:09:36.228065 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Checking segment: {'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=93835) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 01 17:09:36.228454 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Bound using segment: {'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'} {{(pid=93835) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 01 17:09:36.228883 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.managers [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Bound port: fcb572b9-161c-4749-ac69-c810078aa201, host: hv-cinder-79966, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b1d56bb7-3afb-4733-a07b-8f143da5da35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25'}}] {{(pid=93835) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 01 17:09:36.229246 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:36.296054 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] For port fcb572b9-161c-4749-ac69-c810078aa201, host hv-cinder-79966, cleared binding levels {{(pid=93835) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 01 17:09:36.299942 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] For port fcb572b9-161c-4749-ac69-c810078aa201, host hv-cinder-79966, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=fcb572b9-161c-4749-ac69-c810078aa201,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93835) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 01 17:09:36.304339 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7342625'] for port, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:36.336057 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-178485c3-37a1-44f0-af63-167a99b36d6e req-dd6215ad-d84f-492c-ba39-ff851fcd43e8 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:36.337567 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-178485c3-37a1-44f0-af63-167a99b36d6e req-dd6215ad-d84f-492c-ba39-ff851fcd43e8 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 943 time: 0.0593939 Sep 01 17:09:36.339422 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:36.340108 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:36.341580 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] 10.222.0.69 "PUT /v2.0/ports/fcb572b9-161c-4749-ac69-c810078aa201 HTTP/1.1" status: 200 len: 1093 time: 0.5971096 Sep 01 17:09:36.341942 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '80ca5c13-f887-4075-b98f-f4a00ba5ec82', 'tag': 'fcb572b9-161c-4749-ac69-c810078aa201'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:09:36.344149 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-676e299e-4e63-40e0-a2ba-059f55c7ba48" -d '{"events": [{"name": "network-changed", "server_uuid": "80ca5c13-f887-4075-b98f-f4a00ba5ec82", "tag": "fcb572b9-161c-4749-ac69-c810078aa201"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:09:36.371613 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5dde3db-a508-4904-bef1-e0357b85f8fe service neutron] Pushing event updated for resources: {'Port': ['ID=fcb572b9-161c-4749-ac69-c810078aa201,revision_number=3']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:09:36.394349 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:09:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-09e86dce-ea09-4419-9724-46057858bcde x-openstack-request-id: req-09e86dce-ea09-4419-9724-46057858bcde {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:09:36.395475 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "80ca5c13-f887-4075-b98f-f4a00ba5ec82", "tag": "fcb572b9-161c-4749-ac69-c810078aa201", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:09:36.395851 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-09e86dce-ea09-4419-9724-46057858bcde {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:09:36.396353 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '80ca5c13-f887-4075-b98f-f4a00ba5ec82', 'tag': 'fcb572b9-161c-4749-ac69-c810078aa201', 'status': 'completed', 'code': 200} Sep 01 17:09:36.400485 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-178485c3-37a1-44f0-af63-167a99b36d6e req-8970a2b8-4511-41bb-82f7-93e778d321c3 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=204e3130-adb5-4253-8299-b942526ba24c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482337 Sep 01 17:09:36.445550 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5b71c6e-2191-441b-a225-e154993ee347 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:36.447247 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-b5b71c6e-2191-441b-a225-e154993ee347 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c&device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 1096 time: 0.0440996 Sep 01 17:09:36.496895 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-688bee1c-5d1c-40dd-bbc5-f93e2c7b25aa service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=fcb572b9-161c-4749-ac69-c810078aa201 HTTP/1.1" status: 200 len: 217 time: 0.0399175 Sep 01 17:09:36.549244 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-c37d8df6-7db1-4325-841b-7f6b171a94c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:36.550749 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-c37d8df6-7db1-4325-841b-7f6b171a94c9 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=638b3e89-f5ce-4389-adde-079fe5b332cd HTTP/1.1" status: 200 len: 850 time: 0.0457170 Sep 01 17:09:36.601258 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-ddf0f7b3-7f32-4da3-bca3-d3e0cf8b81db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:36.602692 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-ddf0f7b3-7f32-4da3-bca3-d3e0cf8b81db service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0443070 Sep 01 17:09:36.698011 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-e2a62722-a866-4506-b6c5-24d769f851f5 service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0873861 Sep 01 17:09:36.794642 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-b0854a86-17a2-4f44-9aca-7cedc72a01fd req-a0274b36-c94e-4731-9404-4bdb62c6ba4b service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868371 Sep 01 17:09:36.885479 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-676e299e-4e63-40e0-a2ba-059f55c7ba48 req-6f7b4c3f-000e-47b0-b02c-504ec6cb30a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:36.886956 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-676e299e-4e63-40e0-a2ba-059f55c7ba48 req-6f7b4c3f-000e-47b0-b02c-504ec6cb30a0 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c&device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 1096 time: 0.0446603 Sep 01 17:09:36.979284 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-676e299e-4e63-40e0-a2ba-059f55c7ba48 req-43b3aaf8-8f06-4dde-81af-55054a726889 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:36.980749 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-676e299e-4e63-40e0-a2ba-059f55c7ba48 req-43b3aaf8-8f06-4dde-81af-55054a726889 service neutron] 10.222.0.69 "GET /v2.0/networks?id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25 HTTP/1.1" status: 200 len: 912 time: 0.0833645 Sep 01 17:09:37.024572 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-676e299e-4e63-40e0-a2ba-059f55c7ba48 req-3a72671e-39f6-4186-b555-65a895a8f50e service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=fcb572b9-161c-4749-ac69-c810078aa201 HTTP/1.1" status: 200 len: 217 time: 0.0341885 Sep 01 17:09:37.078063 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-676e299e-4e63-40e0-a2ba-059f55c7ba48 req-202eabed-159a-465f-8c55-9ecc6125ab95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:37.079517 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-676e299e-4e63-40e0-a2ba-059f55c7ba48 req-202eabed-159a-465f-8c55-9ecc6125ab95 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=638b3e89-f5ce-4389-adde-079fe5b332cd HTTP/1.1" status: 200 len: 850 time: 0.0463588 Sep 01 17:09:37.126172 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-676e299e-4e63-40e0-a2ba-059f55c7ba48 req-fd1e82bf-61dd-4151-ad0c-6119cc031cff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:37.127612 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-676e299e-4e63-40e0-a2ba-059f55c7ba48 req-fd1e82bf-61dd-4151-ad0c-6119cc031cff service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0379696 Sep 01 17:09:37.218945 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-676e299e-4e63-40e0-a2ba-059f55c7ba48 req-5044e574-d7e2-4502-a0c8-02f7d00ab164 service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808232 Sep 01 17:09:37.312906 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-676e299e-4e63-40e0-a2ba-059f55c7ba48 req-a72aeedd-71c5-4e87-bed3-0f8c94b19503 service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842474 Sep 01 17:09:37.525444 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-948943d1-ac16-441a-b8f0-0c51b24e70a5 req-1c3b0787-40a5-4fdf-b2ab-399753594287 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:37.527111 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-948943d1-ac16-441a-b8f0-0c51b24e70a5 req-1c3b0787-40a5-4fdf-b2ab-399753594287 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 943 time: 0.0517397 Sep 01 17:09:37.564534 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-948943d1-ac16-441a-b8f0-0c51b24e70a5 req-4b2b3d2d-64f8-4bfd-84d7-734ef0fff6bb tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=204e3130-adb5-4253-8299-b942526ba24c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0315905 Sep 01 17:09:38.676586 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb58ac4c-f35a-496a-8154-6cd0dcd3b55c req-abf4d3c2-6169-4d4c-824e-c4e37814fb0a tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:38.678756 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fb58ac4c-f35a-496a-8154-6cd0dcd3b55c req-abf4d3c2-6169-4d4c-824e-c4e37814fb0a tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 943 time: 0.0479882 Sep 01 17:09:38.715088 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-fb58ac4c-f35a-496a-8154-6cd0dcd3b55c req-87e92b18-42d1-401a-bf34-f06b0803df21 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=204e3130-adb5-4253-8299-b942526ba24c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0305686 Sep 01 17:09:39.830916 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0f9f845-69e3-40e4-9f68-69586a2acf4c req-7f23469e-02fb-40fa-8c4e-d498aa4b0211 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:39.833031 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d0f9f845-69e3-40e4-9f68-69586a2acf4c req-7f23469e-02fb-40fa-8c4e-d498aa4b0211 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 943 time: 0.0517995 Sep 01 17:09:39.871669 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d0f9f845-69e3-40e4-9f68-69586a2acf4c req-b1010152-128a-4251-b9ec-ebd120262194 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=204e3130-adb5-4253-8299-b942526ba24c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0321269 Sep 01 17:09:40.353687 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device fcb572b9-161c-4749-ac69-c810078aa201 details requested by agent hyperv_hv-cinder-79966 with host hv-cinder-79966 {{(pid=93837) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 01 17:09:40.443848 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port fcb572b9-161c-4749-ac69-c810078aa201, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=fcb572b9-161c-4749-ac69-c810078aa201,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:09:40.454565 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Returning: {'device': 'fcb572b9-161c-4749-ac69-c810078aa201', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'port_id': 'fcb572b9-161c-4749-ac69-c810078aa201', 'mac_address': 'fa:16:3e:2b:56:5e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 527, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=93837) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 01 17:09:40.495408 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:40.508235 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fcb572b9-161c-4749-ac69-c810078aa201 {{(pid=93837) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 01 17:09:40.527546 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port fcb572b9-161c-4749-ac69-c810078aa201, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=fcb572b9-161c-4749-ac69-c810078aa201,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:09:40.531065 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:40.576561 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=fcb572b9-161c-4749-ac69-c810078aa201,revision_number=4']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:09:40.583746 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:40.584093 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:40.584430 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:40.584763 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:40.585090 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:40.585441 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:40.585764 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:40.586086 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:40.586409 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:40.586731 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:40.587047 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:40.587363 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93837) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:09:40.804072 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] get_ports_and_sgs() called for port_ids ['fcb572b9-161c-4749-ac69-c810078aa201'] {{(pid=93837) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 01 17:09:40.987946 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68b712ce-d323-459d-9983-403623de4094 req-c8de4d47-f96d-4353-8dbc-2fab0ea27432 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:40.989983 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-68b712ce-d323-459d-9983-403623de4094 req-c8de4d47-f96d-4353-8dbc-2fab0ea27432 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 944 time: 0.0511084 Sep 01 17:09:41.027446 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-68b712ce-d323-459d-9983-403623de4094 req-c06a9f7a-7d50-4d71-82ad-9ce6715efcf3 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=204e3130-adb5-4253-8299-b942526ba24c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0314271 Sep 01 17:09:42.137190 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd4cd85-a92b-4713-89a2-ea9e8164984e req-2a976810-2324-41d0-bd56-7112355014d7 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:42.138672 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7cd4cd85-a92b-4713-89a2-ea9e8164984e req-2a976810-2324-41d0-bd56-7112355014d7 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 944 time: 0.0479803 Sep 01 17:09:42.175104 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-7cd4cd85-a92b-4713-89a2-ea9e8164984e req-d12d734b-0e42-4d8e-bdc7-ca1f101a37d5 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=204e3130-adb5-4253-8299-b942526ba24c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0305405 Sep 01 17:09:42.353822 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device fcb572b9-161c-4749-ac69-c810078aa201 up at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 01 17:09:42.401137 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning for port fcb572b9-161c-4749-ac69-c810078aa201 completed by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 01 17:09:42.405048 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.db.provisioning_blocks [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Provisioning complete for port fcb572b9-161c-4749-ac69-c810078aa201 triggered by entity L2. {{(pid=93837) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 01 17:09:42.405466 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-550066'] for port, provisioning_complete {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:42.484116 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-620389'] for port, before_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:42.507430 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '80ca5c13-f887-4075-b98f-f4a00ba5ec82', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fcb572b9-161c-4749-ac69-c810078aa201'}] {{(pid=93837) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:09:42.510106 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01e33a513f50a63734bb7b50046bb3fd0ac95da03866ef8f517e6a7c29124f82" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cf204274-844b-4124-9c1f-878744dc001f" -d '{"events": [{"server_uuid": "80ca5c13-f887-4075-b98f-f4a00ba5ec82", "name": "network-vif-plugged", "status": "completed", "tag": "fcb572b9-161c-4749-ac69-c810078aa201"}]}' {{(pid=93837) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:09:42.524372 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.db [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] For port fcb572b9-161c-4749-ac69-c810078aa201, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=fcb572b9-161c-4749-ac69-c810078aa201,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93837) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:09:42.528652 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748409257683', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748408675386', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748408675404'] for port, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:42.675540 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:09:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8664c035-8db4-493a-8ec7-5a14348b55ac x-openstack-request-id: req-8664c035-8db4-493a-8ec7-5a14348b55ac {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:09:42.675815 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "80ca5c13-f887-4075-b98f-f4a00ba5ec82", "name": "network-vif-plugged", "status": "completed", "tag": "fcb572b9-161c-4749-ac69-c810078aa201", "code": 200}]} {{(pid=93837) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:09:42.676066 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-8664c035-8db4-493a-8ec7-5a14348b55ac {{(pid=93837) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:09:42.676446 dv-cinder-799668-16-iscsi neutron-server[93837]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '80ca5c13-f887-4075-b98f-f4a00ba5ec82', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fcb572b9-161c-4749-ac69-c810078aa201', 'code': 200} Sep 01 17:09:42.702178 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Pushing event updated for resources: {'Port': ['ID=fcb572b9-161c-4749-ac69-c810078aa201,revision_number=5']} {{(pid=93837) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:09:42.798053 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-636c4db8-85e3-436d-848e-517ff911689c req-ed7335a5-b4d4-4bfc-b553-290c34aff327 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:42.799537 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-636c4db8-85e3-436d-848e-517ff911689c req-ed7335a5-b4d4-4bfc-b553-290c34aff327 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 1098 time: 0.0428054 Sep 01 17:09:42.834003 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-636c4db8-85e3-436d-848e-517ff911689c req-d6632a08-5307-4b4d-8f8c-659972f730b9 service neutron] 10.222.0.69 "GET /v2.0/security-groups?id=204e3130-adb5-4253-8299-b942526ba24c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0267987 Sep 01 17:09:43.291408 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77f5c370-25b2-4552-9f2d-9f51d0062a0b req-b663fe42-5f58-4a6b-bb12-9dded3591b40 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:43.292785 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-77f5c370-25b2-4552-9f2d-9f51d0062a0b req-b663fe42-5f58-4a6b-bb12-9dded3591b40 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 945 time: 0.0513873 Sep 01 17:09:43.328982 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-77f5c370-25b2-4552-9f2d-9f51d0062a0b req-7f1c65d4-c4da-438b-84af-a9ba4beead50 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=204e3130-adb5-4253-8299-b942526ba24c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0300825 Sep 01 17:09:44.447833 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b77cd5-111f-4d32-96f2-eba813c0541e req-7d455e8d-85f0-4e4c-b515-475c4ea2a0d3 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:44.449321 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-31b77cd5-111f-4d32-96f2-eba813c0541e req-7d455e8d-85f0-4e4c-b515-475c4ea2a0d3 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 945 time: 0.0539508 Sep 01 17:09:44.486031 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-31b77cd5-111f-4d32-96f2-eba813c0541e req-91222ce6-65ad-4484-85a1-801ef4f8aae1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=204e3130-adb5-4253-8299-b942526ba24c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0308676 Sep 01 17:09:44.595622 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d081d4fc-befb-4827-8e9c-782c0cbf8b90 req-b7463e84-d015-49b6-bfa9-a607dc732115 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:44.597102 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-d081d4fc-befb-4827-8e9c-782c0cbf8b90 req-b7463e84-d015-49b6-bfa9-a607dc732115 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 945 time: 0.0477526 Sep 01 17:09:44.606264 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 33042) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:09:44.610605 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.v2.base [None req-75dc3b5e-810c-4b82-8443-ecc5c6924d8f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Request body: {'floatingip': {'port_id': 'fcb572b9-161c-4749-ac69-c810078aa201'}} {{(pid=93836) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 01 17:09:44.652780 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-75dc3b5e-810c-4b82-8443-ecc5c6924d8f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for floatingip, before_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:45.072306 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-75dc3b5e-810c-4b82-8443-ecc5c6924d8f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for floatingip, precommit_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:45.076051 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-75dc3b5e-810c-4b82-8443-ecc5c6924d8f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_update {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:45.169480 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.db.l3_db [None req-75dc3b5e-810c-4b82-8443-ecc5c6924d8f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Floating IP 24b6e2d9-577f-40af-a918-f79b95ad2c38 associated. External IP: 172.27.1.125, port: fcb572b9-161c-4749-ac69-c810078aa201. Sep 01 17:09:45.368644 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75dc3b5e-810c-4b82-8443-ecc5c6924d8f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Router 983dc48a-7f67-4eed-9560-9f50c5b92a36 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93836) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:09:45.728988 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75dc3b5e-810c-4b82-8443-ecc5c6924d8f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93836) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:09:45.733770 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-75dc3b5e-810c-4b82-8443-ecc5c6924d8f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:45.738361 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0dd0886d-53fe-48c0-a336-f7aea5d180a7 None None] Sync routers for ids ['983dc48a-7f67-4eed-9560-9f50c5b92a36'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:09:45.748574 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0dd0886d-53fe-48c0-a336-f7aea5d180a7 None None] Routers {'983dc48a-7f67-4eed-9560-9f50c5b92a36'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:09:45.749191 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-0dd0886d-53fe-48c0-a336-f7aea5d180a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:09:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['983dc48a-7f67-4eed-9560-9f50c5b92a36'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:09:45.760908 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-75dc3b5e-810c-4b82-8443-ecc5c6924d8f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "PUT /v2.0/floatingips/24b6e2d9-577f-40af-a918-f79b95ad2c38 HTTP/1.1" status: 200 len: 991 time: 1.1536202 Sep 01 17:09:45.761619 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '80ca5c13-f887-4075-b98f-f4a00ba5ec82', 'tag': 'fcb572b9-161c-4749-ac69-c810078aa201'}] {{(pid=93836) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:09:45.764047 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}60a7e58791dd3a103db7a0d35103b09d0a4cb2c205e1177c181e158a6fe3866f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a47835b6-fffa-4cc0-93df-a56679f7a451" -d '{"events": [{"name": "network-changed", "server_uuid": "80ca5c13-f887-4075-b98f-f4a00ba5ec82", "tag": "fcb572b9-161c-4749-ac69-c810078aa201"}]}' {{(pid=93836) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:09:45.870573 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 01 Sep 2021 17:09:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f93b48af-de78-4709-b9ee-d2178651147f x-openstack-request-id: req-f93b48af-de78-4709-b9ee-d2178651147f {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:09:45.870870 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "80ca5c13-f887-4075-b98f-f4a00ba5ec82", "tag": "fcb572b9-161c-4749-ac69-c810078aa201", "status": "completed", "code": 200}]} {{(pid=93836) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:09:45.871118 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-f93b48af-de78-4709-b9ee-d2178651147f {{(pid=93836) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:09:45.871509 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '80ca5c13-f887-4075-b98f-f4a00ba5ec82', 'tag': 'fcb572b9-161c-4749-ac69-c810078aa201', 'status': 'completed', 'code': 200} Sep 01 17:09:45.938615 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a47835b6-fffa-4cc0-93df-a56679f7a451 req-03b73e07-9eff-473e-9198-8bcde8a5c10a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:45.940137 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a47835b6-fffa-4cc0-93df-a56679f7a451 req-03b73e07-9eff-473e-9198-8bcde8a5c10a service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c&device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 1098 time: 0.0457835 Sep 01 17:09:45.950670 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-0dd0886d-53fe-48c0-a336-f7aea5d180a7 None None] Set router 983dc48a-7f67-4eed-9560-9f50c5b92a36 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:09:46.183102 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-0dd0886d-53fe-48c0-a336-f7aea5d180a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '24b6e2d9-577f-40af-a918-f79b95ad2c38', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'floating_ip_address': '172.27.1.125', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'port_id': 'fcb572b9-161c-4749-ac69-c810078aa201', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'mac_address': 'fa:16:3e:2b:56:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80ca5c13-f887-4075-b98f-f4a00ba5ec82', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:09:31Z', 'updated_at': '2021-09-01T17:09:44Z', 'revision_number': 1, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:38Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:09:46.210931 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0dd0886d-53fe-48c0-a336-f7aea5d180a7 None None] Checking router: 983dc48a-7f67-4eed-9560-9f50c5b92a36 for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:09:46.219540 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0dd0886d-53fe-48c0-a336-f7aea5d180a7 None None] Routers {'983dc48a-7f67-4eed-9560-9f50c5b92a36'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:09:46.220157 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-0dd0886d-53fe-48c0-a336-f7aea5d180a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:09:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['983dc48a-7f67-4eed-9560-9f50c5b92a36'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:09:46.282474 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a47835b6-fffa-4cc0-93df-a56679f7a451 req-e6d806bc-c142-4b2d-80d6-8840ea38c352 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:46.284005 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a47835b6-fffa-4cc0-93df-a56679f7a451 req-e6d806bc-c142-4b2d-80d6-8840ea38c352 service neutron] 10.222.0.69 "GET /v2.0/networks?id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25 HTTP/1.1" status: 200 len: 912 time: 0.3369398 Sep 01 17:09:46.324618 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-0dd0886d-53fe-48c0-a336-f7aea5d180a7 None None] Set router 983dc48a-7f67-4eed-9560-9f50c5b92a36 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:09:46.355668 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a47835b6-fffa-4cc0-93df-a56679f7a451 req-2b5697fe-8894-4fbe-8543-4a07ee4f6c98 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=fcb572b9-161c-4749-ac69-c810078aa201 HTTP/1.1" status: 200 len: 999 time: 0.0631621 Sep 01 17:09:46.407140 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a47835b6-fffa-4cc0-93df-a56679f7a451 req-0c93c068-7679-43cc-bea2-994ebbf3ff53 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:46.408888 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a47835b6-fffa-4cc0-93df-a56679f7a451 req-0c93c068-7679-43cc-bea2-994ebbf3ff53 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=638b3e89-f5ce-4389-adde-079fe5b332cd HTTP/1.1" status: 200 len: 850 time: 0.0460153 Sep 01 17:09:46.455523 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a47835b6-fffa-4cc0-93df-a56679f7a451 req-1130ae25-4796-45c5-a89c-d4494b76af4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:09:46.457035 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a47835b6-fffa-4cc0-93df-a56679f7a451 req-1130ae25-4796-45c5-a89c-d4494b76af4d service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0412872 Sep 01 17:09:46.550715 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-0dd0886d-53fe-48c0-a336-f7aea5d180a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '24b6e2d9-577f-40af-a918-f79b95ad2c38', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'floating_ip_address': '172.27.1.125', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'port_id': 'fcb572b9-161c-4749-ac69-c810078aa201', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'mac_address': 'fa:16:3e:2b:56:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80ca5c13-f887-4075-b98f-f4a00ba5ec82', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:09:31Z', 'updated_at': '2021-09-01T17:09:44Z', 'revision_number': 1, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:38Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:09:46.553897 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a47835b6-fffa-4cc0-93df-a56679f7a451 req-2ed8bbf4-c080-46a4-802d-fc5300c8be79 service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0888634 Sep 01 17:09:46.576895 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0dd0886d-53fe-48c0-a336-f7aea5d180a7 None None] The sync data for ids ['983dc48a-7f67-4eed-9560-9f50c5b92a36'] in dv-cinder-799668-16-iscsi is: [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_floatingips': [{'id': '24b6e2d9-577f-40af-a918-f79b95ad2c38', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'floating_ip_address': '172.27.1.125', 'floating_network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'router_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'port_id': 'fcb572b9-161c-4749-ac69-c810078aa201', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'mac_address': 'fa:16:3e:2b:56:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80ca5c13-f887-4075-b98f-f4a00ba5ec82', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-01T17:09:31Z', 'updated_at': '2021-09-01T17:09:44Z', 'revision_number': 1, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:38Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:09:46.652634 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-a47835b6-fffa-4cc0-93df-a56679f7a451 req-22aa8ef4-19ee-42a9-ad98-14c433a90f81 service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0908625 Sep 01 17:09:46.763248 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44c841f7-627d-4d68-ba40-ac25441afc68 None None] New status for floating IP 24b6e2d9-577f-40af-a918-f79b95ad2c38: ACTIVE {{(pid=93837) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:09:51.246153 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-e6ea910e-5101-4368-a41c-21d8f16ffaba None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:53.788202 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:53.797808 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-47c71ce4-6df1-4d25-a8b8-9a2c693822d4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:54.943705 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:56.584143 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:09:56.701687 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:11.578567 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:10:21.246890 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-f42fb273-10f2-42c1-9694-3ef8846f7d79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:23.795435 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:23.799803 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-a44d84c0-6971-4bee-bf54-e37c1ad9cc3a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:24.946330 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:26.593896 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:26.690842 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:37.099774 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7655b27d-8002-4902-9595-234b0ef52727 req-51b0b394-0452-497c-bd3f-9a34cae99cb3 service neutron] 10.222.0.69 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0405264 Sep 01 17:10:37.186145 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7655b27d-8002-4902-9595-234b0ef52727 req-2cc87fbe-c8b0-4865-ad57-db44de008226 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:10:37.187647 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7655b27d-8002-4902-9595-234b0ef52727 req-2cc87fbe-c8b0-4865-ad57-db44de008226 service neutron] 10.222.0.69 "GET /v2.0/ports?tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c&device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 1098 time: 0.0461705 Sep 01 17:10:37.291652 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7655b27d-8002-4902-9595-234b0ef52727 req-e5f25d23-5f8e-432c-adb7-15c436e16cc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:10:37.293067 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7655b27d-8002-4902-9595-234b0ef52727 req-e5f25d23-5f8e-432c-adb7-15c436e16cc7 service neutron] 10.222.0.69 "GET /v2.0/networks?id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25 HTTP/1.1" status: 200 len: 912 time: 0.0849764 Sep 01 17:10:37.364604 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7655b27d-8002-4902-9595-234b0ef52727 req-4332ca88-5d9d-4217-a936-b76371e083a9 service neutron] 10.222.0.69 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=fcb572b9-161c-4749-ac69-c810078aa201 HTTP/1.1" status: 200 len: 1001 time: 0.0622549 Sep 01 17:10:37.414718 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7655b27d-8002-4902-9595-234b0ef52727 req-aebebd4f-cafc-42d0-831b-9847bf343e09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:10:37.416141 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7655b27d-8002-4902-9595-234b0ef52727 req-aebebd4f-cafc-42d0-831b-9847bf343e09 service neutron] 10.222.0.69 "GET /v2.0/subnets?id=638b3e89-f5ce-4389-adde-079fe5b332cd HTTP/1.1" status: 200 len: 850 time: 0.0432665 Sep 01 17:10:37.460964 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7655b27d-8002-4902-9595-234b0ef52727 req-675807a0-a9c7-42e6-8572-1da146a90cbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:10:37.462442 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7655b27d-8002-4902-9595-234b0ef52727 req-675807a0-a9c7-42e6-8572-1da146a90cbf service neutron] 10.222.0.69 "GET /v2.0/ports?network_id=adfcf065-5df4-4f7a-9b14-3f96b61d0c25&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0389137 Sep 01 17:10:37.555963 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7655b27d-8002-4902-9595-234b0ef52727 req-cd30cd4f-c8ad-4876-b27b-a7553cbc480b service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858846 Sep 01 17:10:37.644589 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-7655b27d-8002-4902-9595-234b0ef52727 req-a4de5037-fd3a-4d45-a3fc-9094a584700a service neutron] 10.222.0.69 "GET /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809054 Sep 01 17:10:47.110334 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d690209-7b8c-451d-96dc-5eb3a0ca1da4 req-42b683ab-d5b6-4f4d-a45b-0868fd896dd4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:10:47.111704 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3d690209-7b8c-451d-96dc-5eb3a0ca1da4 req-42b683ab-d5b6-4f4d-a45b-0868fd896dd4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 945 time: 0.0503078 Sep 01 17:10:47.148351 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-3d690209-7b8c-451d-96dc-5eb3a0ca1da4 req-0ae1ff7c-3d01-42a2-b313-bc01cd1543e3 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=204e3130-adb5-4253-8299-b942526ba24c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0300000 Sep 01 17:10:48.262052 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab45ad4f-ad46-4f37-81b1-a7c7a066287f req-5647ad33-1ab9-416c-9ef9-4d3fb18b089c tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:10:48.263500 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ab45ad4f-ad46-4f37-81b1-a7c7a066287f req-5647ad33-1ab9-416c-9ef9-4d3fb18b089c tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 945 time: 0.0479064 Sep 01 17:10:48.301495 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-ab45ad4f-ad46-4f37-81b1-a7c7a066287f req-ce468576-168f-4638-8464-a80612fad7f4 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=204e3130-adb5-4253-8299-b942526ba24c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0307608 Sep 01 17:10:48.576535 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:10:49.153568 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-f35b09ad-69b3-4294-8ead-9e56e31d340f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93835) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:10:49.155052 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-f35b09ad-69b3-4294-8ead-9e56e31d340f tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.69 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 945 time: 0.0503769 Sep 01 17:10:49.250870 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Deleting port fcb572b9-161c-4749-ac69-c810078aa201 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:10:49.251213 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:49.338292 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] For port fcb572b9-161c-4749-ac69-c810078aa201, host hv-cinder-79966, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79966',level=0,port_id=fcb572b9-161c-4749-ac69-c810078aa201,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:10:49.338666 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:49.415830 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3b68b2-44d7-442f-82df-5da23f24049c req-367cef49-dc5c-4104-8509-1f0163b66bc8 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=93836) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 01 17:10:49.417314 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4f3b68b2-44d7-442f-82df-5da23f24049c req-367cef49-dc5c-4104-8509-1f0163b66bc8 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/ports?device_id=80ca5c13-f887-4075-b98f-f4a00ba5ec82 HTTP/1.1" status: 200 len: 945 time: 0.0488243 Sep 01 17:10:49.463714 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [req-4f3b68b2-44d7-442f-82df-5da23f24049c req-ca84964a-325a-4c0a-a26f-3654c4e682ef tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups?id=204e3130-adb5-4253-8299-b942526ba24c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404739 Sep 01 17:10:49.514553 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for floatingip, precommit_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:49.514940 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1827857'] for floatingip, after_update {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:49.515257 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.db.l3_db [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Floating IP 24b6e2d9-577f-40af-a918-f79b95ad2c38 disassociated. External IP: 172.27.1.125, port: fcb572b9-161c-4749-ac69-c810078aa201. Sep 01 17:10:49.515596 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Calling delete_port for fcb572b9-161c-4749-ac69-c810078aa201 owned by compute:nova {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:10:49.642162 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:49.675156 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event deleted for resources: {'Port': ['ID=fcb572b9-161c-4749-ac69-c810078aa201,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:10:49.685510 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:49.685854 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:49.686201 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:49.686546 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:49.686890 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:49.687230 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:49.687566 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:49.687900 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:49.688238 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:49.688570 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:49.688902 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:49.689225 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93835) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:49.798417 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Router 983dc48a-7f67-4eed-9560-9f50c5b92a36 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:10:49.905330 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:10:49.914835 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11eb1934-4c38-4a6d-9649-3131d994e0c2 None None] Sync routers for ids ['983dc48a-7f67-4eed-9560-9f50c5b92a36'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:10:49.924300 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11eb1934-4c38-4a6d-9649-3131d994e0c2 None None] Routers {'983dc48a-7f67-4eed-9560-9f50c5b92a36'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:10:49.925644 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-11eb1934-4c38-4a6d-9649-3131d994e0c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:10:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['983dc48a-7f67-4eed-9560-9f50c5b92a36'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:10:49.955747 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] No DVR routers for this DVR port fcb572b9-161c-4749-ac69-c810078aa201 on host hv-cinder-79966 {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:10:49.958687 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for port, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:49.960814 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [req-c36cd3b8-59a8-4cc5-a8e0-219b0611d756 req-6aacca74-de22-41db-b735-6bc2256b3ec1 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.69 "DELETE /v2.0/ports/fcb572b9-161c-4749-ac69-c810078aa201 HTTP/1.1" status: 204 len: 173 time: 0.7987807 Sep 01 17:10:49.961281 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '80ca5c13-f887-4075-b98f-f4a00ba5ec82', 'name': 'network-vif-deleted', 'tag': 'fcb572b9-161c-4749-ac69-c810078aa201'}] {{(pid=93835) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 01 17:10:49.963552 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.67/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a375ab2afc278642563031f763cbd05eae2556fc99f72cdac5af2319c336c8ac" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3cebedc5-02af-4de0-97b7-bc1cfab2d614" -d '{"events": [{"server_uuid": "80ca5c13-f887-4075-b98f-f4a00ba5ec82", "name": "network-vif-deleted", "tag": "fcb572b9-161c-4749-ac69-c810078aa201"}]}' {{(pid=93835) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 01 17:10:50.008075 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 01 Sep 2021 17:10:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0eaa5443-3482-43cb-a4f9-66c3138ed059 x-openstack-request-id: req-0eaa5443-3482-43cb-a4f9-66c3138ed059 {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 01 17:10:50.008350 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "80ca5c13-f887-4075-b98f-f4a00ba5ec82", "name": "network-vif-deleted", "tag": "fcb572b9-161c-4749-ac69-c810078aa201", "status": "completed", "code": 200}]} {{(pid=93835) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 01 17:10:50.008608 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.67/compute/v2.1/os-server-external-events used request id req-0eaa5443-3482-43cb-a4f9-66c3138ed059 {{(pid=93835) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 01 17:10:50.009111 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '80ca5c13-f887-4075-b98f-f4a00ba5ec82', 'name': 'network-vif-deleted', 'tag': 'fcb572b9-161c-4749-ac69-c810078aa201', 'status': 'completed', 'code': 200} Sep 01 17:10:50.042651 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-11eb1934-4c38-4a6d-9649-3131d994e0c2 None None] Set router 983dc48a-7f67-4eed-9560-9f50c5b92a36 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:10:50.250157 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-11eb1934-4c38-4a6d-9649-3131d994e0c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:38Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:10:50.280551 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11eb1934-4c38-4a6d-9649-3131d994e0c2 None None] Checking router: 983dc48a-7f67-4eed-9560-9f50c5b92a36 for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:10:50.288630 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11eb1934-4c38-4a6d-9649-3131d994e0c2 None None] Routers {'983dc48a-7f67-4eed-9560-9f50c5b92a36'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:10:50.289237 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-11eb1934-4c38-4a6d-9649-3131d994e0c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:10:24Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['983dc48a-7f67-4eed-9560-9f50c5b92a36'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:10:50.394480 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-11eb1934-4c38-4a6d-9649-3131d994e0c2 None None] Set router 983dc48a-7f67-4eed-9560-9f50c5b92a36 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:10:50.552948 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 33260) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:10:50.595513 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-11eb1934-4c38-4a6d-9649-3131d994e0c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:38Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:10:50.610418 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:50.622050 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11eb1934-4c38-4a6d-9649-3131d994e0c2 None None] The sync data for ids ['983dc48a-7f67-4eed-9560-9f50c5b92a36'] in dv-cinder-799668-16-iscsi is: [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:33Z', 'revision_number': 4, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi', '_interfaces': [{'id': '548dbdbe-f56b-4275-a3c7-8c0623662b05', 'name': '', 'network_id': 'adfcf065-5df4-4f7a-9b14-3f96b61d0c25', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'mac_address': 'fa:16:3e:2b:58:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_interface', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:32Z', 'updated_at': '2021-09-01T17:06:38Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'subnets': [{'id': '638b3e89-f5ce-4389-adde-079fe5b332cd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:10:50.634150 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:50.685659 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:50.688340 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:50.689582 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "DELETE /v2.0/security-groups/204e3130-adb5-4253-8299-b942526ba24c HTTP/1.1" status: 204 len: 168 time: 0.1355331 Sep 01 17:10:50.692675 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33262) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:10:50.698595 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=204e3130-adb5-4253-8299-b942526ba24c,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:10:50.705593 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:50.706481 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:50.706898 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:50.707215 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.api.v2.resource [None req-585466e8-341d-4769-9f0c-71279df23840 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] show failed (client error): The resource could not be found. Sep 01 17:10:50.707404 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:50.707740 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:50.708082 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:50.708419 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:50.708748 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:50.709079 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:50.709514 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:50.710017 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:50.710358 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3e24eb2-3588-4bd6-b01f-7e43be0bef05 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:10:50.711577 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-585466e8-341d-4769-9f0c-71279df23840 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "GET /v2.0/security-groups/204e3130-adb5-4253-8299-b942526ba24c HTTP/1.1" status: 404 len: 347 time: 0.0178642 Sep 01 17:10:50.712163 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33264) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:10:50.843040 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-be52ac71-9f00-4632-a317-8b4b72c6c054 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Deleting port d7f345cd-8a9f-48ef-88f5-09f6ff08959a {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:10:50.843388 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-be52ac71-9f00-4632-a317-8b4b72c6c054 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:50.854685 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-632e26a2-3b1e-4f9e-9fae-b6a3c74e3374 None None] New status for floating IP 24b6e2d9-577f-40af-a918-f79b95ad2c38: DOWN {{(pid=93837) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 01 17:10:50.920227 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-be52ac71-9f00-4632-a317-8b4b72c6c054 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:50.920557 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-be52ac71-9f00-4632-a317-8b4b72c6c054 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:50.932347 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-be52ac71-9f00-4632-a317-8b4b72c6c054 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Calling delete_port for d7f345cd-8a9f-48ef-88f5-09f6ff08959a owned by network:floatingip {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:10:51.071387 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-be52ac71-9f00-4632-a317-8b4b72c6c054 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:51.103050 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be52ac71-9f00-4632-a317-8b4b72c6c054 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Pushing event deleted for resources: {'Port': ['ID=d7f345cd-8a9f-48ef-88f5-09f6ff08959a,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:10:51.165492 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-be52ac71-9f00-4632-a317-8b4b72c6c054 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks [] for floatingip, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:51.168028 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-be52ac71-9f00-4632-a317-8b4b72c6c054 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-24112'] for floatingip, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:51.169220 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-be52ac71-9f00-4632-a317-8b4b72c6c054 tempest-AttachVolumeTestJSON-1248969480 tempest-AttachVolumeTestJSON-1248969480-project] 10.222.0.67 "DELETE /v2.0/floatingips/24b6e2d9-577f-40af-a918-f79b95ad2c38 HTTP/1.1" status: 204 len: 168 time: 0.4553041 Sep 01 17:10:51.247980 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-e071f661-474c-47d7-be12-6b57f75fa0a7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:52.710911 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device fcb572b9-161c-4749-ac69-c810078aa201 no longer exists at agent hyperv_hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:10:52.730866 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] No Port match for: fcb572b9-161c-4749-ac69-c810078aa201 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:10:52.731208 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Device fcb572b9-161c-4749-ac69-c810078aa201 not bound to the agent host hv-cinder-79966 {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:10:53.795467 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:53.804154 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-5c05674d-7571-4674-b913-cd6f0acd4e24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:54.699044 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33292) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:10:54.948872 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:55.036346 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-297420cf-f6de-41cd-bbbf-3f9cba69cab4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1832465'] for router_interface, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:55.277898 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-297420cf-f6de-41cd-bbbf-3f9cba69cab4 admin admin] Deleting port 548dbdbe-f56b-4275-a3c7-8c0623662b05 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:10:55.278156 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-297420cf-f6de-41cd-bbbf-3f9cba69cab4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:55.356701 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [None req-297420cf-f6de-41cd-bbbf-3f9cba69cab4 admin admin] For port 548dbdbe-f56b-4275-a3c7-8c0623662b05, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=548dbdbe-f56b-4275-a3c7-8c0623662b05,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:10:55.357099 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-297420cf-f6de-41cd-bbbf-3f9cba69cab4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:55.370177 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-297420cf-f6de-41cd-bbbf-3f9cba69cab4 admin admin] Calling delete_port for 548dbdbe-f56b-4275-a3c7-8c0623662b05 owned by network:router_interface {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:10:55.544598 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-297420cf-f6de-41cd-bbbf-3f9cba69cab4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:55.571436 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-297420cf-f6de-41cd-bbbf-3f9cba69cab4 admin admin] Pushing event deleted for resources: {'Port': ['ID=548dbdbe-f56b-4275-a3c7-8c0623662b05,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:10:55.735172 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-297420cf-f6de-41cd-bbbf-3f9cba69cab4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611377', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1832589'] for router_interface, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:55.952695 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-297420cf-f6de-41cd-bbbf-3f9cba69cab4 admin admin] Router 983dc48a-7f67-4eed-9560-9f50c5b92a36 has already been hosted by L3 agent 9a6a8168-0427-48b7-a784-9acda7b6608c {{(pid=93835) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 01 17:10:56.059098 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-297420cf-f6de-41cd-bbbf-3f9cba69cab4 admin admin] Notify agent at l3_agent.dv-cinder-799668-16-iscsi the message routers_updated {{(pid=93835) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 01 17:10:56.064160 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-297420cf-f6de-41cd-bbbf-3f9cba69cab4 admin admin] 10.222.0.67 "PUT /v2.0/routers/983dc48a-7f67-4eed-9560-9f50c5b92a36/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.3641052 Sep 01 17:10:56.066749 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33294) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:10:56.068830 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cfe082eb-9aa6-4552-8628-3c708170ab6d None None] Sync routers for ids ['983dc48a-7f67-4eed-9560-9f50c5b92a36'] in dv-cinder-799668-16-iscsi {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 01 17:10:56.077791 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfe082eb-9aa6-4552-8628-3c708170ab6d None None] Routers {'983dc48a-7f67-4eed-9560-9f50c5b92a36'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:10:56.078398 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-cfe082eb-9aa6-4552-8628-3c708170ab6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:10:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['983dc48a-7f67-4eed-9560-9f50c5b92a36'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:10:56.284339 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-cfe082eb-9aa6-4552-8628-3c708170ab6d None None] Set router 983dc48a-7f67-4eed-9560-9f50c5b92a36 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:10:56.423200 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] Notify callbacks [] for router, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:56.467213 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-cfe082eb-9aa6-4552-8628-3c708170ab6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:10:55Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:10:56.493414 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cfe082eb-9aa6-4552-8628-3c708170ab6d None None] Checking router: 983dc48a-7f67-4eed-9560-9f50c5b92a36 for host: dv-cinder-799668-16-iscsi {{(pid=93838) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 01 17:10:56.501687 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfe082eb-9aa6-4552-8628-3c708170ab6d None None] Routers {'983dc48a-7f67-4eed-9560-9f50c5b92a36'} bound to L3 agent in host dv-cinder-799668-16-iscsi {{(pid=93838) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 01 17:10:56.502354 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-cfe082eb-9aa6-4552-8628-3c708170ab6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799668-16-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-01T16:50:24Z,description=,heartbeat_timestamp=2021-09-01T17:10:54Z,host='dv-cinder-799668-16-iscsi',id=9a6a8168-0427-48b7-a784-9acda7b6608c,load=0,resource_versions=,resources_synced=,started_at=2021-09-01T16:50:24Z,topic='l3_agent')) {'router_ids': ['983dc48a-7f67-4eed-9560-9f50c5b92a36'], 'active': True} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:10:56.524243 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:56.576917 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] Deleting port d55b1a8d-8a79-43d6-8747-4bd1a56c7584 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:10:56.577172 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:56.593337 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:56.610390 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_dvr_db [None req-cfe082eb-9aa6-4552-8628-3c708170ab6d None None] Set router 983dc48a-7f67-4eed-9560-9f50c5b92a36 gateway port host: dv-cinder-799668-16-iscsi {{(pid=93838) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 01 17:10:56.664700 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] For port d55b1a8d-8a79-43d6-8747-4bd1a56c7584, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=d55b1a8d-8a79-43d6-8747-4bd1a56c7584,segment=NetworkSegment(74f97e23-9fdf-4c83-acaf-c3c8fafa1987),segment_id=74f97e23-9fdf-4c83-acaf-c3c8fafa1987)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:10:56.665081 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:56.679750 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] Calling delete_port for d55b1a8d-8a79-43d6-8747-4bd1a56c7584 owned by network:router_gateway {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:10:56.723620 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:56.794937 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.l3_hamode_db [None req-cfe082eb-9aa6-4552-8628-3c708170ab6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:10:55Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}], 'dv-cinder-799668-16-iscsi', False) {} {{(pid=93838) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:10:56.825420 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cfe082eb-9aa6-4552-8628-3c708170ab6d None None] The sync data for ids ['983dc48a-7f67-4eed-9560-9f50c5b92a36'] in dv-cinder-799668-16-iscsi is: [{'id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'name': 'tempest-AttachVolumeTestJSON-1166592683-router', 'tenant_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'external_fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158'}], 'enable_snat': True}, 'gw_port_id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:10:55Z', 'revision_number': 5, 'project_id': 'aef2053b969d4ca58b0e1ec3a7e7a06c', 'gw_port': {'id': 'd55b1a8d-8a79-43d6-8747-4bd1a56c7584', 'name': '', 'network_id': 'e28b8145-06a4-43a8-a9f2-9a7014f96a23', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:4c:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '983dc48a-7f67-4eed-9560-9f50c5b92a36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 642, 'fixed_ips': [{'subnet_id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'ip_address': '172.27.1.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799668-16-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-01T17:06:29Z', 'updated_at': '2021-09-01T17:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'bb03a81f-6f53-44d6-90e9-69e9ac09604e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799668-16-iscsi'}] {{(pid=93838) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 01 17:10:56.858604 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:56.884602 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] Pushing event deleted for resources: {'Port': ['ID=d55b1a8d-8a79-43d6-8747-4bd1a56c7584,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:10:56.942707 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1827887'] for router_gateway, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.030382 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1821713', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-4617'] for router, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.032475 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.078221 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1821722'] for router, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.078809 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 983dc48a-7f67-4eed-9560-9f50c5b92a36 {{(pid=93835) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 01 17:10:57.083776 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] Notify callbacks [] for router, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.084990 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-abdf05ab-00f4-40fe-9031-ea12f51b0a86 admin admin] 10.222.0.67 "DELETE /v2.0/routers/983dc48a-7f67-4eed-9560-9f50c5b92a36 HTTP/1.1" status: 204 len: 168 time: 1.0173011 Sep 01 17:10:57.087726 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33296) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:10:57.134675 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.db_base_plugin_v2 [None req-fa218b09-a3dc-4fab-9c5b-63d9771049bd admin admin] Deleting subnet 638b3e89-f5ce-4389-adde-079fe5b332cd {{(pid=93835) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 01 17:10:57.137742 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fa218b09-a3dc-4fab-9c5b-63d9771049bd admin admin] Notify callbacks [] for subnet, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.176752 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fa218b09-a3dc-4fab-9c5b-63d9771049bd admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8197692'] for subnet, precommit_delete_associations {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.262670 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fa218b09-a3dc-4fab-9c5b-63d9771049bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-531904'] for subnet, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.317265 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fa218b09-a3dc-4fab-9c5b-63d9771049bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-531915', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648561', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7342711', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5120114'] for subnet, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.344760 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa218b09-a3dc-4fab-9c5b-63d9771049bd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=638b3e89-f5ce-4389-adde-079fe5b332cd,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:10:57.352448 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-fa218b09-a3dc-4fab-9c5b-63d9771049bd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for subnet, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.354385 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-fa218b09-a3dc-4fab-9c5b-63d9771049bd admin admin] 10.222.0.67 "DELETE /v2.0/subnets/638b3e89-f5ce-4389-adde-079fe5b332cd HTTP/1.1" status: 204 len: 168 time: 0.2657342 Sep 01 17:10:57.356861 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33298) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:10:57.360748 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98ad5c8f-41ac-4803-be5f-2a5f2ca49837 None None] Network adfcf065-5df4-4f7a-9b14-3f96b61d0c25 requested from dv-cinder-799668-16-iscsi {{(pid=93837) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 01 17:10:57.430745 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-636079'] for network, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.492944 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Deleting port 75fbd6de-c7da-4bed-8fb8-60e2230aca29 {{(pid=93835) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 01 17:10:57.493294 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748409258518'] for port, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.556107 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.db [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] For port 75fbd6de-c7da-4bed-8fb8-60e2230aca29, host dv-cinder-799668-16-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799668-16-iscsi',level=0,port_id=75fbd6de-c7da-4bed-8fb8-60e2230aca29,segment=NetworkSegment(b1d56bb7-3afb-4733-a07b-8f143da5da35),segment_id=b1d56bb7-3afb-4733-a07b-8f143da5da35)] {{(pid=93835) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 01 17:10:57.556469 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1833831'] for port, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.570624 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.plugin [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Calling delete_port for 75fbd6de-c7da-4bed-8fb8-60e2230aca29 owned by network:dhcp {{(pid=93835) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 01 17:10:57.650465 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-620322', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-231213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748409257701', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748408675377', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7342616'] for port, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.676383 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Pushing event deleted for resources: {'Port': ['ID=75fbd6de-c7da-4bed-8fb8-60e2230aca29,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:10:57.678232 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] No DVR routers for this DVR port 75fbd6de-c7da-4bed-8fb8-60e2230aca29 on host dv-cinder-799668-16-iscsi {{(pid=93835) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 01 17:10:57.746467 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-530491', 'neutron.services.segments.db._delete_segments_for_network-8748409195713'] for network, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.756350 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['adfcf065-5df4-4f7a-9b14-3f96b61d0c25']}} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:10:57.766251 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b1d56bb7-3afb-4733-a07b-8f143da5da35') {'for_net_delete': True} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:10:57.766547 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.services.segments.db [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b1d56bb7-3afb-4733-a07b-8f143da5da35') {} {{(pid=93835) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 01 17:10:57.777110 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748409207893', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8197639'] for segment, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.796629 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462'] for segment, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.803904 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Releasing vlan 527 on physical network physnet1 to pool {{(pid=93835) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 01 17:10:57.804351 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-717462', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7342797'] for segment, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: Traceback (most recent call last): Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: timer() Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: cb(*args, **kw) Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: return func(*args, **kwargs) Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: self._notify() Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: self.callback(batched_events) Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: event.method(event) Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: aggregate_uuid = self.p_client.list_aggregates( Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: return f(self, *a, **k) Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._get(url).json() Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: return self.request(url, 'GET', **kwargs) Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: base_url = self.get_endpoint(auth, allow=allow, Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 01 17:10:57.807148 dv-cinder-799668-16-iscsi neutron-server[93835]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 01 17:10:57.809415 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89d16021-64c6-4b18-a0bc-442245617490 None None] DHCP port deletion for adfcf065-5df4-4f7a-9b14-3f96b61d0c25 request from dv-cinder-799668-16-iscsi {{(pid=93837) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 01 17:10:57.862096 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-530466', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1648408', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1827843'] for network, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.867656 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611412'] for network, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:57.869528 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] 10.222.0.67 "DELETE /v2.0/networks/adfcf065-5df4-4f7a-9b14-3f96b61d0c25 HTTP/1.1" status: 204 len: 168 time: 0.5114932 Sep 01 17:10:57.880968 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae7bf5f3-f270-4f60-b55e-87212aea01e8 admin admin] Pushing event deleted for resources: {'Network': ['ID=adfcf065-5df4-4f7a-9b14-3f96b61d0c25,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:10:58.045464 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33302) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:10:58.084882 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-9059215b-13b1-4fce-9013-745375d35f60 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=aef2053b969d4ca58b0e1ec3a7e7a06c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0381570 Sep 01 17:10:58.087390 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33304) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:10:58.134898 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-6c43ac98-415f-4ce1-b1a0-92993cc612fa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:58.156267 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-6c43ac98-415f-4ce1-b1a0-92993cc612fa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:58.206163 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-6c43ac98-415f-4ce1-b1a0-92993cc612fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:58.208696 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-6c43ac98-415f-4ce1-b1a0-92993cc612fa admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:10:58.209877 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-6c43ac98-415f-4ce1-b1a0-92993cc612fa admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/97653f8a-1566-456d-b255-a61890dc4dfd HTTP/1.1" status: 204 len: 168 time: 0.1216013 Sep 01 17:10:58.219205 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c43ac98-415f-4ce1-b1a0-92993cc612fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97653f8a-1566-456d-b255-a61890dc4dfd,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:10:58.714104 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device d55b1a8d-8a79-43d6-8747-4bd1a56c7584 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:10:58.733485 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: d55b1a8d-8a79-43d6-8747-4bd1a56c7584 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:10:58.733765 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device d55b1a8d-8a79-43d6-8747-4bd1a56c7584 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:10:58.734198 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 548dbdbe-f56b-4275-a3c7-8c0623662b05 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:10:58.754032 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 548dbdbe-f56b-4275-a3c7-8c0623662b05 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:10:58.754384 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 548dbdbe-f56b-4275-a3c7-8c0623662b05 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:10:58.754790 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 75fbd6de-c7da-4bed-8fb8-60e2230aca29 no longer exists at agent ovs-agent-dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 01 17:10:58.776235 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.plugin [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] No Port match for: 75fbd6de-c7da-4bed-8fb8-60e2230aca29 {{(pid=93837) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 01 17:10:58.776873 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron.plugins.ml2.rpc [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Device 75fbd6de-c7da-4bed-8fb8-60e2230aca29 not bound to the agent host dv-cinder-799668-16-iscsi {{(pid=93837) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 01 17:10:59.858766 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 33350) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:10:59.959904 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0c40ccf8-5956-4f82-9a67-395365866464 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:00.057913 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0c40ccf8-5956-4f82-9a67-395365866464 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:00.061882 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0c40ccf8-5956-4f82-9a67-395365866464 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:00.098780 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-0c40ccf8-5956-4f82-9a67-395365866464 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=e1e35a9059fd48b5b4c99662c705cee1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2389653 Sep 01 17:11:00.100692 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c40ccf8-5956-4f82-9a67-395365866464 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c88f815-b388-4a79-ad42-7b66dc3d2ed6,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:11:00.101529 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33354) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:11:00.150183 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-027ee962-c832-4caf-8dd4-9a56f9def4d9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:00.171118 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-027ee962-c832-4caf-8dd4-9a56f9def4d9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:00.217734 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-027ee962-c832-4caf-8dd4-9a56f9def4d9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:00.220249 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-027ee962-c832-4caf-8dd4-9a56f9def4d9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:00.221505 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-027ee962-c832-4caf-8dd4-9a56f9def4d9 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/3c88f815-b388-4a79-ad42-7b66dc3d2ed6 HTTP/1.1" status: 204 len: 168 time: 0.1188862 Sep 01 17:11:00.228988 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-027ee962-c832-4caf-8dd4-9a56f9def4d9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c88f815-b388-4a79-ad42-7b66dc3d2ed6,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:11:00.474412 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33360) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:11:00.488159 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ba09cbe8-f79e-4eef-92e9-11a861981c6f admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:00.574347 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ba09cbe8-f79e-4eef-92e9-11a861981c6f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:00.578953 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-ba09cbe8-f79e-4eef-92e9-11a861981c6f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:00.617889 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-ba09cbe8-f79e-4eef-92e9-11a861981c6f admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=5a325c6f00314d12ac261edcd83ba9f8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1423976 Sep 01 17:11:00.618759 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba09cbe8-f79e-4eef-92e9-11a861981c6f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2417bbae-df03-462b-9605-0d3ab07a5791,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:11:00.620535 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 33362) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:11:00.667568 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e912a3e9-8994-49aa-9d04-bd1887567c58 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:00.690715 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e912a3e9-8994-49aa-9d04-bd1887567c58 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:00.735496 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e912a3e9-8994-49aa-9d04-bd1887567c58 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:00.738163 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e912a3e9-8994-49aa-9d04-bd1887567c58 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:00.739295 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-e912a3e9-8994-49aa-9d04-bd1887567c58 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/2417bbae-df03-462b-9605-0d3ab07a5791 HTTP/1.1" status: 204 len: 168 time: 0.1177132 Sep 01 17:11:00.746577 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e912a3e9-8994-49aa-9d04-bd1887567c58 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2417bbae-df03-462b-9605-0d3ab07a5791,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:11:01.821823 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 33392) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:11:01.930227 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5b90021e-35a7-4907-b7b5-3f2855519006 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:02.024705 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5b90021e-35a7-4907-b7b5-3f2855519006 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:02.029202 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5b90021e-35a7-4907-b7b5-3f2855519006 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:02.068902 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-5b90021e-35a7-4907-b7b5-3f2855519006 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=0d0505ddbd7d48e7ad94765d59c82bee&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2459846 Sep 01 17:11:02.070948 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b90021e-35a7-4907-b7b5-3f2855519006 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7fdf72bc-8bd0-43f3-be7d-289c9882c929,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:11:02.071640 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33396) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:11:02.146374 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-0929f02c-8101-456f-a7d6-9db80f37ddfe admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:02.168716 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-0929f02c-8101-456f-a7d6-9db80f37ddfe admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:02.217154 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-0929f02c-8101-456f-a7d6-9db80f37ddfe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:02.219873 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-0929f02c-8101-456f-a7d6-9db80f37ddfe admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:02.221583 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-0929f02c-8101-456f-a7d6-9db80f37ddfe admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/7fdf72bc-8bd0-43f3-be7d-289c9882c929 HTTP/1.1" status: 204 len: 168 time: 0.1481969 Sep 01 17:11:02.229620 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0929f02c-8101-456f-a7d6-9db80f37ddfe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7fdf72bc-8bd0-43f3-be7d-289c9882c929,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:11:10.083423 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 33518) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:11:10.209413 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0ea95626-0663-491e-a12a-7c557287c35d admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:10.297461 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0ea95626-0663-491e-a12a-7c557287c35d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:10.301376 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-0ea95626-0663-491e-a12a-7c557287c35d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:10.342604 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-0ea95626-0663-491e-a12a-7c557287c35d admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=5d211bfd355f4e909a6a771e039fad8d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2580643 Sep 01 17:11:10.343608 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea95626-0663-491e-a12a-7c557287c35d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9c40956-02d6-4a7b-b47c-d4153f6a514d,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:11:10.345213 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33522) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:11:10.395198 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-759a1d54-992e-40b3-9345-395498d9f9f4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:10.416591 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-759a1d54-992e-40b3-9345-395498d9f9f4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:10.462448 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-759a1d54-992e-40b3-9345-395498d9f9f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:10.465036 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-759a1d54-992e-40b3-9345-395498d9f9f4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:10.466211 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-759a1d54-992e-40b3-9345-395498d9f9f4 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/d9c40956-02d6-4a7b-b47c-d4153f6a514d HTTP/1.1" status: 204 len: 168 time: 0.1191475 Sep 01 17:11:10.474413 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-759a1d54-992e-40b3-9345-395498d9f9f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9c40956-02d6-4a7b-b47c-d4153f6a514d,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:11:10.731287 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33528) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:11:10.745412 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-45f00484-1156-422c-82c9-8ea457b30a03 admin admin] Notify callbacks [] for security_group, before_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:10.834999 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-45f00484-1156-422c-82c9-8ea457b30a03 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:10.838686 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-45f00484-1156-422c-82c9-8ea457b30a03 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:10.876774 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-45f00484-1156-422c-82c9-8ea457b30a03 admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=3e56095f6b574748b9c4e23f2edaf0a9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1442602 Sep 01 17:11:10.877622 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45f00484-1156-422c-82c9-8ea457b30a03 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=981a9e11-1a45-48a1-a826-55f2e4643471,revision_number=1']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:11:10.879995 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 33530) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:11:10.929652 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6e45397c-d26e-47e8-b571-7bc0925ea3f4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:10.950463 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6e45397c-d26e-47e8-b571-7bc0925ea3f4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:10.997046 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6e45397c-d26e-47e8-b571-7bc0925ea3f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:10.999667 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-6e45397c-d26e-47e8-b571-7bc0925ea3f4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:11.000831 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-6e45397c-d26e-47e8-b571-7bc0925ea3f4 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/981a9e11-1a45-48a1-a826-55f2e4643471 HTTP/1.1" status: 204 len: 168 time: 0.1197510 Sep 01 17:11:11.009128 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e45397c-d26e-47e8-b571-7bc0925ea3f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=981a9e11-1a45-48a1-a826-55f2e4643471,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:11:11.314687 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 33536) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:11:11.327473 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e7fb5dc0-c99a-4d4d-9660-bf06ada9afae admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:11.415219 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e7fb5dc0-c99a-4d4d-9660-bf06ada9afae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:11.418869 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-e7fb5dc0-c99a-4d4d-9660-bf06ada9afae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:11.456193 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-e7fb5dc0-c99a-4d4d-9660-bf06ada9afae admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=d1e278646b4442e4aa27cbba82126692&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1404092 Sep 01 17:11:11.457044 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7fb5dc0-c99a-4d4d-9660-bf06ada9afae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a61da67-e31e-466c-980e-364f3b7560e6,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:11:11.458857 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33538) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:11:11.506424 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a11be2da-99d8-4817-aea8-89c08da7c1a5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:11.527678 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a11be2da-99d8-4817-aea8-89c08da7c1a5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:11.572766 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a11be2da-99d8-4817-aea8-89c08da7c1a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:11.575297 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-a11be2da-99d8-4817-aea8-89c08da7c1a5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:11.576440 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-a11be2da-99d8-4817-aea8-89c08da7c1a5 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/4a61da67-e31e-466c-980e-364f3b7560e6 HTTP/1.1" status: 204 len: 168 time: 0.1165872 Sep 01 17:11:11.584333 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a11be2da-99d8-4817-aea8-89c08da7c1a5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a61da67-e31e-466c-980e-364f3b7560e6,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:11:21.249463 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-f9ab44b3-b8ce-443f-948c-23e26385be7c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:23.786918 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:23.807655 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-97d3554c-6855-461d-9932-bf6d1a244c0f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:24.952804 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:25.574834 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:11:26.592625 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:26.747264 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:46.863662 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 33748) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:11:46.964921 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5d45024c-6de2-457a-9cd4-5d4e1606505e admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:47.056845 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5d45024c-6de2-457a-9cd4-5d4e1606505e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:47.060618 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-5d45024c-6de2-457a-9cd4-5d4e1606505e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:47.097735 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-5d45024c-6de2-457a-9cd4-5d4e1606505e admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=024868e360594923be789197992ce100&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2330015 Sep 01 17:11:47.098578 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d45024c-6de2-457a-9cd4-5d4e1606505e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9cd81a93-7de1-4cb0-a796-1b8d6073ebde,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:11:47.100519 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [-] (93835) accepted ('10.222.0.67', 33752) {{(pid=93835) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:11:47.149371 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-0a0e3ea0-c92d-48a2-adb3-43c74bb5100f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:47.171113 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-0a0e3ea0-c92d-48a2-adb3-43c74bb5100f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:47.222447 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-0a0e3ea0-c92d-48a2-adb3-43c74bb5100f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:47.225017 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron_lib.callbacks.manager [None req-0a0e3ea0-c92d-48a2-adb3-43c74bb5100f admin admin] Notify callbacks [] for security_group, before_response {{(pid=93835) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:47.226198 dv-cinder-799668-16-iscsi neutron-server[93835]: INFO neutron.wsgi [None req-0a0e3ea0-c92d-48a2-adb3-43c74bb5100f admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/9cd81a93-7de1-4cb0-a796-1b8d6073ebde HTTP/1.1" status: 204 len: 168 time: 0.1246598 Sep 01 17:11:47.233563 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a0e3ea0-c92d-48a2-adb3-43c74bb5100f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9cd81a93-7de1-4cb0-a796-1b8d6073ebde,revision_number=None']} {{(pid=93835) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:11:51.251439 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-ddd834ca-b2a4-4eaa-b259-b5b2506b9c86 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:53.790575 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:53.808386 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-856ca9d5-b62d-4eeb-8602-065dc0063ae6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:54.955943 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:56.599975 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:11:56.752421 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:02.573434 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:12:17.911446 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 33944) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:12:18.012390 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Notify callbacks [] for security_group, before_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:18.101836 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:18.105475 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_create {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:18.144688 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] 10.222.0.67 "GET /v2.0/security-groups?tenant_id=0b9c803d09b04fec8d58aeb4a7ae6566&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2322598 Sep 01 17:12:18.145591 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=08363e92-b16b-4256-a694-84e67cc49962,revision_number=1']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:12:18.147385 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [-] (93836) accepted ('10.222.0.67', 33948) {{(pid=93836) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 01 17:12:18.164397 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:12:18.164685 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:12:18.165037 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:12:18.165376 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:12:18.165735 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:12:18.166087 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:12:18.166425 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:12:18.166755 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:12:18.167089 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:12:18.167415 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:12:18.167740 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:12:18.168064 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71fb85a8-bf31-4711-a137-45cc966456ea admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799668-16-iscsi {{(pid=93836) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 01 17:12:18.208043 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b69220a7-a9c5-4417-b355-330ba7315e32 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:18.229089 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b69220a7-a9c5-4417-b355-330ba7315e32 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:18.278326 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b69220a7-a9c5-4417-b355-330ba7315e32 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1643461'] for security_group, after_delete {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:18.282184 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron_lib.callbacks.manager [None req-b69220a7-a9c5-4417-b355-330ba7315e32 admin admin] Notify callbacks [] for security_group, before_response {{(pid=93836) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:18.283340 dv-cinder-799668-16-iscsi neutron-server[93836]: INFO neutron.wsgi [None req-b69220a7-a9c5-4417-b355-330ba7315e32 admin admin] 10.222.0.67 "DELETE /v2.0/security-groups/08363e92-b16b-4256-a694-84e67cc49962 HTTP/1.1" status: 204 len: 168 time: 0.1350644 Sep 01 17:12:18.291085 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b69220a7-a9c5-4417-b355-330ba7315e32 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08363e92-b16b-4256-a694-84e67cc49962,revision_number=None']} {{(pid=93836) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 01 17:12:21.251907 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-72c45919-2eec-46f7-b030-8d8c71008aa6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:23.801518 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:23.811369 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-cf0252cc-78fd-4db3-a41e-7fd0ed02b01c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:24.958325 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:26.597946 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:26.750443 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:39.573019 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:12:51.254460 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-40565c51-3f23-4266-a3b2-8d574c5ebfb1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:53.792155 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:53.811663 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-5f9ee4d2-f392-4188-9186-159818788e75 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:54.962816 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:56.601260 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:12:56.762086 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:13:16.572493 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:13:21.254897 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-079ad868-cdb8-4a0f-b243-8f2079c601b9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:13:23.794149 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:13:23.811367 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-254ac9cd-41c8-4720-9acb-5851e001a7e6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:13:24.964792 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:13:26.602956 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:13:26.764347 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:13:46.988151 dv-cinder-799668-16-iscsi neutron-server[93836]: DEBUG neutron.wsgi [req-496c01e4-a58d-4e9e-8187-211faab46a88 req-c1902a65-b12d-48c9-b58a-bbf536f3d74e service neutron] (93836) timed out ('10.222.0.69', 52049) {{(pid=93836) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Sep 01 17:13:51.255896 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-8af91f3e-d75a-4857-8b5e-6e4347edd3f0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:13:53.571227 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:13:53.796737 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:13:53.811277 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-dab1abfb-b891-42a7-a797-ed4cafad7e99 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:13:54.706273 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [req-f13b3082-8086-4c3b-9180-d34b453c320f req-46c11b32-370f-4ef8-a19b-79701ff20c9d service neutron] (93835) timed out ('10.222.0.69', 52079) {{(pid=93835) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Sep 01 17:13:54.967388 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:13:56.606271 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:13:56.773219 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:14:21.256758 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-f653f308-ecbc-4c6a-b6a3-d2920b598d6d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:14:23.801706 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:14:23.812127 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-0ffa1a32-5fbc-435a-9159-27a290f174b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:14:24.972037 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:14:26.608870 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:14:26.784030 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:14:30.569790 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:14:51.258419 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-9c983030-8dba-41d0-8afd-edf16ea901dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:14:53.811179 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:14:53.815851 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-39952377-3bfc-4f64-9a82-c20250a7ef58 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:14:54.973722 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:14:56.612589 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:14:56.808386 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:15:07.569185 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:15:21.258865 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-99711fe6-c8fe-4946-ab08-08b188323c36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:15:23.810021 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:15:23.816989 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7467ac16-5118-42fc-80b0-59a5f6527710 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:15:24.976106 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:15:26.615100 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:15:26.813824 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:15:44.568248 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:15:51.260797 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-4dd90835-8988-451d-836f-ef9e1c927c07 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:15:53.804060 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:15:53.819278 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-2785d727-8c45-4fbd-980e-710769e4a808 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:15:54.980295 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:15:56.618272 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:15:56.807271 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:16:21.261710 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-c0d8277b-0c24-4702-88d4-5af2c2719db7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:16:21.566805 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:16:23.813329 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:16:23.824062 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-5dcb1125-32ef-4a8e-9b13-b08bf4ec2479 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:16:24.982484 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:16:26.620559 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:16:26.853336 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:16:37.276484 dv-cinder-799668-16-iscsi neutron-server[93835]: DEBUG neutron.wsgi [req-35ba1ded-4ae2-4d4a-8eb8-8b3512fa8baa req-928dbf63-806b-4c42-bcbf-5427eeac711c service neutron] (93835) timed out ('10.222.0.69', 52058) {{(pid=93835) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Sep 01 17:16:51.262514 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-4a9e4d75-18be-4a61-bddf-efad3f06799b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:16:53.805514 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:16:53.823687 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-3ee4afcd-0351-4bc7-a287-f885639bc1e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:16:54.984623 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:16:56.624091 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:16:56.852622 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:16:58.565781 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 01 17:17:21.262954 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-4dfc2779-c627-4187-8a7e-beb8da95de52 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:17:23.810538 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-64a22815-5dc5-4255-8315-60bb2eeb0503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:17:23.823712 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-32fd40ce-6ef2-4e86-9b54-486689d126f0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:17:24.986993 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-17822e84-5136-4c25-aa65-e40805ad4e76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:17:26.626965 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-caabca60-49d6-468a-9f1e-7bf25e9e0171 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:17:26.851814 dv-cinder-799668-16-iscsi neutron-server[93837]: DEBUG neutron_lib.callbacks.manager [None req-7e7465c5-4e8d-4485-838a-95548940429c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748409125084', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-549989'] for agent, after_update {{(pid=93837) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 01 17:17:35.564763 dv-cinder-799668-16-iscsi neutron-server[93838]: DEBUG neutron.db.agents_db [None req-5d4aa06a-2fed-4a64-89dd-a8d9d1cd4d69 None None] Agent healthcheck: found 6 active agents {{(pid=93838) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}